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I.   INTRODUCTION 

A .   BACKGROUND 

The  driving  force  behind  modern  weapon  systems  is  the 
processor.  At  present,  most  weapon  systems  utilize  a  tradi- 
tional single-CPU  serial  computer  for  their  processing. 
Unfortunately,  such  a  computer  can  process  a  certain  amount 
of  data  in  a  fixed  amount  of  time  and  no  more.  A  modern 
radar  or  sonar  can  overwhelm  the  system  processor  with  a 
flood  of  raw  data.  If  only  part  of  that  data  is  processed, 
the  rest  is  lost  forever.  A  new,  more  powerful  computer  is 
required  to  handle  more  data.  This  thesis  is  part  of  an 
effort  to  improve  the  processing  power  of  weapon  systems. 

Multiple  computers  working  in  parallel  offer  significant 
increases  in  processing  power  in  a  way  that  provides  flex- 
ibility and  expandability.  If  one  needs  more  processing 
power,  one  adds  more  computers. 

The  biggest  problem  in  parallel  multi-computer  networks 
is  interprocessor  communication.  This  communication  is  us- 
ually handled  in  one  of  two  ways.  The  traditional  method  has 
been  to  connect  multiple  computers  together  by  way  of  a 
shared  bus.  The  computers  communicate  by  leaving  messages 
in  a  single  shared  memory.  The  shared  memory  and  shared  bus 
create  bottlenecks,  however.  Memory  also  creates  a  bottle- 
neck, since  bus  bandwidth   is  higher   than  memory  bandwidth. 


The  number  of  computers  that  can  be  attached  is  limited  by 
the  bus  bandwidth  and/or  memory  bandwidth.  A  second  approach 
is  to  have  computers  communicate  with  each  other  by  passing 
messages  along  direct  links.  In  such  systems,  each  computer 
has  its  own  memory. 

This  thesis  concentrates  on  the  latter  method,  since  it 
is  attractive  for  use  in  a  weapon  system  for  reasons  of 
flexibility,  growth  potential,  fault  tolerance,  lower  costs, 
better  response  time,  and  higher  system  availability. 

Microprocessors  would  seem  well  suited  for  a  parallel 
multi-computer  network  in  a  weapon  system  as  they  are  inex- 
pensive, small,  lightweight,  and  increasingly  powerful. 
Until  now,  however,  microprocessors  were  designed  to  operate 
as  stand  alone  computers.  Parallelism,  with  its  requirement 
for  communication  between  computers,  was  a  difficult  pro- 
blem. Since  they  were  not  originally  intended  for  this  role, 
their  architectures  were  not  suited  for  it.  If  they  had  any 
provisions  for  communications  at  all,  they  were  added  on  as 
an  afterthought. 

A  microprocessor  family  called  the  Transputer,  designed 
from  the  ground  up  for  parallelism,  is  now  available  from 
INMOS  corporation.  It  features  four  full  duplex  serial  com- 
munication links  and  a  language  also  specifically  designed 
for  parallel  processing.  The  Transputer  is  ideal  as  a  build- 
ing block  for  a  parallel  system  of  microprocessors. 


obviously  the  evaluation  of  any  computer  system,  be  it 
single  or  multi-processor,  depends  upon  the  problem.  This 
thesis  evaluates  a  network  of  Transputers  working  on  a  pro- 
blem that  can  be  broken  up  into  independent  work  packets. 
Each  packet  contains  parameters  required  to  process  part  of 
the  problem.  Packets  may  be  combined  into  a  bundle  to  make 
communications  between  nodes  more  efficient.  The  amount  of 
computation  per  packet  may  be  very  small  or  very  large  and 
may  vary  depending  on  the  particular  packet. 

A  critical  part  of  any  parallel  multi-computer  network 
is  the  work  distribution  algorithm.  Such  an  algorithm  known 
as  the  Workfarm  is  simple  and  very  effective  for  many  pro- 
blems including  Ray  Tracing  and  Mandelbrot  Set  and  is  used 
in  this  thesis  [MaSh87]. 

With  four  links  on  each  Transputer,  many  physical  topo- 
logies for  a  network  are  possible.  To  make  communication  and 
configuration  software  less  complex,  a  very  regular  and 
symmetric  topology  is  often  desirable.  There  are  many  such 
topologies  available,  from  a  simple  linear  array  or  binary 
tree  to  more  exotic  designs  like  hypercube  or  hypernet 
[HwGh87] . 

The  time  it  takes  for  a  network  of  Transputer  to  com- 
plete a  problem  using  a  workfarm  is  primarily  dependent  on 
the  following  factors:  the  number  and  speed  of  the  Trans- 
puters, the  number  of  computations  per  packet,  the  number  of 


packets  per  bundle,  and  the  total  number  of  packets  in  the 
problem. 

This  thesis  will  examine  how  these  factors  are  interre- 
lated. The  two  primary  questions  addressed  are,  given  a 
workfarm,  1)  how  many  Transputers  will  be  required  to  solve 
a  problem  given  a  time  limit,  and  2)  how  fast  can  a  problem 
be  solved  for  a  given  number  of  Transputers? 

The  resulting  predictions  will  be  compared  to  actual 
results  on  two  specific  problems:  Mandelbrot  Set  [Po86]  and 
Coordinate  Transformation  [Ri87].  These  problems  can  be 
characterized  by  their  divisibility  into  work  packets  which 
can  be  processed  in  any  order  and  by  their  massive  computa- 
tional requirements. 

B.   THESIS  OVERVIEW 

Chapter  II  presents  a  brief  look  at  the  Transputer 
system.  Chapter  III  discusses  the  workfarm,  how  it  is  imple- 
mented on  a  network  of  Transputers,  and  what  topology  is 
used.  Chapter  IV  presents  the  results  of  timing  studies 
using  the  workfarm.  Chapter  V  uses  the  findings  of  Chapter 
IV  to  predict  the  performance  of  the  Coordinate  Transforma- 
tion and  Mandelbrot  Set  problems  and  compares  them  with  the 
actual  results.  Chapter  VI  presents  the  conclusions  and  re- 
commendations of  the  thesis. 


II.   THE  SYSTEM 

A .   GENERAL 

It  is  hard  to  separate  the  Transputer  hardware  and  Occam 
software.  They  are  so  tightly  intertwined  that  is  easier  to 
treat  them  as  a  single  entity;  the  Transputer  system.  A 
basic  understanding  of  this  system  is  necessary  when  pro- 
gramming a  network  of  Transputers.  Although  this  learning 
may  seem  onerous,  it  may  well  be  the  reason  Transputers  are 
relatively  easy  to  program  in  parallel  compared  with  other 
microprocessors  and  languages.  The  reader  is  assumed  to  be 
familiar  with  the  fundamentals  of  the  Transputer  architec- 
ture and  the  Occam  programming  language.  For  those  un- 
familiar with  Transputers,  [In88]  and  [PoMa87]  are  excellent 
starting  points.  This  chapter  highlights  the  knowledge  ne- 
cessary for  efficient  parallel  processing  and  performance 
maximization. 

Despite  a  network  of  Transputers ' s  tremendous  power,  a 
program  has  to  be  as  efficient  as  possible  to  realize  the 
full  potential.  To  do  so,  the  programmer  must  first  ensure 
that  each  individual  Transputer  is  optimized  and  then  that 
the  network  is.  The  latter  is  primarily  a  matter  of  work 
distribution  and  communication.  The  following  is  a  synopsis 
of  Transputer  performance  maximization;  a  complete  reference 
can  be  found  in  [At87]. 


B.   SINGLE  TRANSPUTER  OPTIMIZATION 

It  is  extremely  desirable  to  keep  all  the  data  struc- 
tures and  code  in  the  on-chip  memory.  An  on-chip  memory 
cycle  takes  one  processor  cycle  (50  nanoseconds  for  the 
latest  20MHz  Transputers).  Although  variable,  depending  on 
the  instruction  and  on  the  speed  of  the  DRAM  chips,  external 
memory  references  usually  take  five  processor  cycles 
[In87a].  In  other  words,  one  external  memory  access  takes 
five  times  as  long  as  an  on-chip  memory  access. 

Given  a  choice  between  data  structures  on-chip  or  pro- 
gram code  on-chip  but  not  both,  one  would  choose  data  struc- 
tures. A  Transputer  word  holds  four  bytes;  one  memory  access 
of  program  code  returns  four  single  byte  instructions.  That, 
combined  with  the  principle  of  locality,  means  accessing 
program  instructions  from  external  memory  is  not  nearly  as 
slow  as  accessing  data  structures  from  external  memory. 

Transputer  memory  is  arranged  as  follows,  from  the  base 
of  memory  upwards:  system  space,  data  space,  code  space, 
with  any  unused  space  on  top.  Off  chip  (external)  memory  is 
not  allotted  until  there  is  no  free  on-chip  memory  remain- 
ing. The  Occam  compiler  and  Transputer  loader  software  auto- 
matically places  data  (data  structures,  workspaces,  etc.) 
lower  than  program  code  on  the  Occam  map  [At87];  hence, 
program  code  only  resides  in  on-chip  memory  if  the  data 
space  has  already  been  accommodated. 


The  programmer  has  control   over  the  order  in  which 
data  structures   occur  in  memory  through  the  order  in  which 
they  are  declared  in  the  code.   Simply  put,   data  structures 
declared  last   in  a   local  block  are  placed  lower  in  the  me- 
mory map  than  their  predecessors. 

Large  data  structures,  such  as  arrays,  should  be  de- 
clared first  in  a  local  block,  followed  by  any  variables,  so 
that  the  variables  are  allotted  memory  lower  in  the  map, 
ahead  of  the  large  arrays.  Otherwise,  frequently  used  vari- 
ables may  be  allotted  off  chip  memory.  To  ensure  large  data 
structures  do  not  monopolize  on-chip  memory,  they  can  be 
declared  in  a  global  process.  In  keeping  with  proper  pro- 
gramming practices,  i.e.,  declaring  data  structures  locally, 
the  global  data  structures  can  be  artificially  declared 
locally  using  abbreviations  with  no  performance  cost. 

Concurrent  process  workspaces  also  reside  in  the  data 
portion  of  the  memory  map.  The  programmer  controls  which 
processes  lie  lower  in  the  memory  map  by  the  order  in  which 
they  are  declared.  Like  data  structures,  those  processes 
declared  last  are  allotted  workspaces  lower  in  the  memory 
map. 

To  finetune  the  Transputer  further,  awareness  of  where 
variables  lie  relative  to  the  workspace  pointer  is  useful. 
Only  a  single  byte  instruction  is  required  to  manipulate  the 
first  16  locations  above  the  workspace  pointer  because  the 
four  bit  relative  address  fits   in   the   lower   half   of  the 


single  byte   instruction.  This   optimization  is  technique  is 
useful  in  a  local  block  with  more  than  16  variables. 

C.   MULTIPLE  TRANSPUTER  OPTIMIZATION 

A  key  to  maximizing  the  performance  of  a  network  of 
Transputers  is  decoupling  communication  from  calculation. 
This  is  accomplished  by  running  communication  and  calcula- 
tion processes  separately  and  in  parallel.  Other  processes, 
also  running  in  parallel,  act  as  buffers  between  the  com- 
munication and  calculation  processes.  The  processes  communi- 
cate among  themselves  through  internal  or  external  channels. 
With  such  a  setup,  a  Transputer  may  now  communicate  and 
calculate  simultaneously,  with  little  degradation  in  either 
area. 

Equally  important,  the  communication  processes  must 
always  run  at  high  priority  and  the  calculation  processes  at 
low  priority.  Consider  a  network  of  Transputers.  If  each 
Transputer  only  passes  messages  when  finished  its  own  cal- 
culation, the  majority  of  the  Transputers  in  the  network 
will  constantly  lie  idle,  waiting  to  receive  work  or  to  send 
results.  The  communication  must  take  precedence  so  that  the 
message  passing  is  uninhibited. 

Because  the  communication  and  calculation  are  decoupled 
in  each  Transputer,  the  communication  does  not  significantly 
affect  the  ongoing  calculation.  How  much  calculation  degra- 
dation actually  occurs  during  ongoing  communication  was 
researched  in  [Ha87]  and  [Br88].   In   a   nutshell,   a  single 
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Transputer  communicating  on  all  four  links  at  full  capacity, 
which  is  the  worst  case  scenario,  can  still  calculate  at 
approximately  75%  of  its  maximum  capability  [Ha87].  The 
separate  DMA  engines  on  the  chip  make  this  possible,  al- 
though the  degradation  is  caused  by  internal  bus  contention 
between  the  link  engines  and  the  central  processor. 

The  actual  link  data  rates  have  been  investigated  pre- 
viously in  [Va87]  and  [Br88].  To  summarize,  one  can  expect 
rates  of  approximately  2.3  Mbytes/second  through  T800  links 
during  bidirectional  communication  and  1.7  Mbytes/second 
during  unidirectional  communication.  The  T414  has  rates  of 
1.5  Mbytes/second  during  bidirectional  communication  and 
0.76  Mbytes/second  during  unidirectional  communication 
[Br88].  These  rates  assume  no  external  memory  usage.  The 
T800  communicates  significantly  faster  than  the  T414  because 
of  a  handshaking  improvement  in  link  communication  [In87b]. 

A  third  area  in  which  a  programmer  can  significantly 
affect  performance  is  the  length  of  the  communication  mes- 
sage. The  overhead  to  send  a  single  integer  over  a  link  is 
the  same  as  that  to  send  an  array  of  100  integers,  for  ex- 
ample. Obviously  it  is  better  to  keep  messages  as  long  as 
possible  and  cut  down  on  the  overhead. 

As  the  message  length  grows,  however,  the  probability 
increases  that  its  data  structure  will  reside  in  off  chip 
memory.  That  of  course  means  significant  performance  degra- 
dation. 


The  trick  is  to  keep  the  message  as  long  as  possible 
without  going  into  off  chip  memory.  The  programmer  can  fi- 
gure out  the  happy  medium  by  keeping  track  of  how  much  data 
structure  space  he  is  using  and  making  sure  it  is  less  than 
the  on-chip  memory  size.  If  it  is  more,  the  programmer  has 
to  shorten  his  message  arrays  until  all  the  data  structures 
fit  in  on-chip  memory. 

D.   MISCELLANEOUS  TIPS 

As  pointed  out  in  [Br88],  the  timer  should  not  be  util- 
ized in  the  B004  T414  Transputer.  It  does  not  return  an 
accurate  measure  of  time  because  the  T414  is  executing  pro- 
cesses that  the  user  is  not  aware  of  and  these  hidden  pro- 
cesses figure  into  any  timing  measurements.  The  timer  should 
be  utilized  on  a  remote  Transputer  and  the  time  returned 
over  a  link  for  display. 

Occam  is  very  strongly  typed.  In  a  network  of  Transpu- 
ters, where  message  passing  is  paramount,  this  comes  heavily 
into  play.  The  type  of  data  at  one  end  of  a  channel  must  be 
the  same  type  that  comes  out  the  other  end  or  the  program 
deadlocks.  This  error  is  particularly  insidious  because 
there  is  always  a  lot  of  communication  in  a  network  and 
there  are  no  messages  to  tell  why  the  program  has  stopped. 
For  this  reason,  it  is  imperative  to  begin  testing  on  a 
B004,  followed  by  testing  on  a  single  remote  Transputer, 
before  testing  a  program  on  a  network  of  Transputers. 
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Protocols  are  used  to  identify  what  is  coming  across  a 
channel;  however,  only  data  of  that  protocol  will  be  able  to 
use  the  channel.  A  more  flexible  approach  is  use  of  the  CHAN 
OF  ANY  declaration  which  allows  the  programmer  to  send  any- 
thing down  a  channel  as  long  as  the  same  thing  comes  out  the 
other  end. 

Variant  protocols  offer  the  same  flexibility.  They  are 
expensive  in  terms  of  overhead,  however.  A  cheaper  but 
trickier  method  is  to  declare  channels  using  CHAN  OF  ANY  and 
sending  arrays  through  these  channels  with  a  single  byte  or 
integer  tag  at  the  head.  The  tag  allows  the  receiver  to  know 
what  type  of  data  follows  in  the  array.  This  manual  method 
requires  retyping,  a  practice  requiring  much  care  from  the 
programmer,  and  should  be  well  tested  on  a  single  remote 
Transputer  before  it  is  used  in  a  network. 

All  Transputer  links  may  run  at  the  standard  speed  of 
10  Mbits/second;  however,  most  members  of  the  Transputer 
family  are  now  capable  of  running  their  link's  at  20  Mbits/- 
second.  The  B004,  B002,  and  BOOl  are  the  only  commonly  used 
boards  restricted  to  the  standard  link  speed.  Fortunately, 
the  20  Mbits/second  capable  boards  allow  their  Link  Os  to  be 
set  at  10  Mbits/second  while  the  rest  of  the  links  run  at  20 
Mbits/second.  Normally  a  network  of  Transputers  is  run  at  20 
Mbits/second  for  fastest  communications  except  where  an 
input  is  accepted  from  a  B004  host  computer  or  BOOl/2  RS232 
interface  board.  It  is  easy  to  tell  if  the  DIP  switches  have 
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been  improperly  set;  an  error  message  will  flash  when  the 
extracted  code  will  not  load  through  the  mismatched  link. 

E.   DEBUGGING 

The  Transputer's  internal  architecture  time  slices  par- 
allel processes  to  simulate  parallel  processing.  This  aids 
the  programmer  because  he  can  test  his  program  on  one  Trans- 
puter; then,  with  minimal  change,  run  his  program  on  a  net- 
work of  Transputers  as  intended. 

Based  on  programming  experiences,  it  is  recommended  that 
a  program  intended  for  a  network  of  Transputers  be  developed 
in  three  steps.  First,  the  calculation  process  is  tested 
sequentially  on  the  B004  T414  Transputer.  The  B004's  host 
computer  allows  the  programmer  to  easily  display  any  vari- 
ables in  the  executing  program. 

The  next  step  is  to  run  the  same  program  on  a  remote 
Transputer  connected  to  the  B004.  Any  bugs  with  the  external 
links  or  channel  protocols  will  reveal  themselves  in  this 
step.  Because  a  program  may  work  on  one  Transputer  using 
internal  channels  but  not  on  multiple  Transputers  using 
external  channels,  this  step  is  important.  During  execution, 
variables  may  be  passed  over  external  links  back  to  the  B004 
for  display. 

Finally,  the  program  is  run  on  a  network  of  Transputers. 
There  may  still  be  bugs  but  at  least  the  programmer  knows 
that  a  large  portion  of  his  code  is  good,  especially  the 
channel  protocols.  The  first  two  testing   systems  remain  and 
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the  programmer   can  reuse  them  to  check  out  any  questions  he 
may  have . 

The  problem  is  that  in  a  network  of  Transputers  a  pro- 
gram either  works  or  it  deadlocks.  When  a  program  deadlocks, 
all  the  programmer  sees  is  a  blinking  cursor.  There  is  very 
little  the  programmer  can  do  to  determine  what  went  wrong, 
where  the  problem  occurred,  or  to  obtain  a  state  trace. 
Additionally,  because  the  Transputers  run  in  parallel,  it  is 
next  to  impossible  to  display  variables  to  a  monitor  during 
execution. 


13 


III.   THE  WORKFARM 

A .  GENERAL 

A  problem  has  to  be  divisible  for  use  in  a  parallel 
system.  A  parallel  system  of  Transputers  is  so  powerful  that 
the  problem  should  also  be  computation  intensive.  This  the- 
sis deals  with  problems  that  are  both  divisible  and  computa- 
tion intensive.  Problems  that  are  not  divisible  (assuming  a 
single  input  data  stream)  are  not  germane  to  this  thesis. 

B.  PIPELINE 

The  pipeline  is  a  well  known  work  distribution  algor- 
ithm. It  is  ideal  for  problems  that  divide  into  tasks  that 
can  be  assigned  to  separate  processors.  With  the  Occam  pro- 
gramming language  and  the  Transputer  links,  it  is  easy  to 
configure  a  network  of  Transputers  into  a  pipeline,  as  de- 
monstrated in  Figures  3.1  and  3.2. 

Unfortunately,  pipelines  are  only  as  fast  as  their  slow- 
est process.  In  a  pipeline,  the  Transputers  execute  the 
following  cycle: 


WHILE  TRUE 
SEQ 

communicate 
synchronize 
calculate 
synchronize 
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Figure  3.1 
Transputer  Pipeline 


[4]CHAN  OF  ANY   chan 


PAR 
input 
procl 
proc2 
proc3 


in, 

chan[0 ] 
chan[ 1 ] 
chan[ 2] 


chan[0  ]  ) 
chan[l]) 
chan[2] ) 
chan[3]  ) 


output  (chan[3],  out) 


Figure  3.2 
Transputer  Pipeline  Code 
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To  maximize  performance,  the  calculation  time  of  the  proces- 
ses must  be  equal.  This  limits  the  problem  range. 

A  special  case  is  when  each  processor  in  a  pipeline  can 
do  the  same  task.  Heat  transfer  along  a  wire  is  such  a  pro- 
blem, although  in  this  case  the  pipeline  is  bidirectional. 
The  calculation  time  for  each  processor  is  equal  and  so  the 
network  can  achieve  peak  efficiency.  The  configuration  for 
this  special  pipeline,  as  demonstrated  in  Figures  3.3  and 
3.4,  is  even  simpler  than  that  of  the  standard  pipeline. 

C .   WORKFARM 

The  workfarm  is  a  work  distribution  algorithm  in  which 
each  processor  does  the  same  task  on  part  of  a  problem  in- 
stead of  each  processor  doing  a  separate  task  as  in  the 
standard  pipeline.  It  is  highly  effective  on  problems  that 
can  be  divided  up  into  independent  work  packets,  where  each 
packet  consists  of  parameters  necessary  to  calculate  a  part 
of  the  problem.  Independent  means  that  no  packet  is  depen- 
dent on  any  others.  If  one  packet  of  the  total  were  lost, 
only  a  small  piece  of  the  problem  would  be  missing.  The 
amount  of  work  required  per  packet  may  vary. 

The  workfarm  has  two  distinct  parts:  the  Controller  and 
the  Farm.  The  controller  combines  packets  into  request  bun- 
dles and  passes  the  request  bundles  to  the  farm,  ensuring 
that  there  are  never  more  bundles  in  the  farm  than  the  farm 
can  handle.  The  controller  also  receives  the  result  bundles. 
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Figure  3.3 
Bidirectional  Pipeline 


[ num. nodes+1] CHAN  OF  ANY  right,  left: 
SEQ 

input  ( right [0],  left[0]) 
PAR  i  =  0  FOR  num. nodes 

node  (right[i],  right[i+l], 
left[i+l],  left[i]) 
output  ( right [num. nodes ] ,  left [num. nodes ] 


Figure  3.4 
Bidirectional  Pipeline  Code 
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The  packets  are  grouped  into  bundles  to  optimize   the  length 
of  the  message  arrays  as  discussed  earlier. 

The  farm  consists  of  multiple  nodes  arranged  in  some 
topology.  This  thesis  uses  a  linear  array  of  nodes  for 
reasons  explained  later.  A  workfarm  of  this  type  is  pictured 
in  Figure  3.5. 

When  a  node  receives  a  request  bundle  and  is  not  "busy" 
it  accepts  the  new  one  for  processing.  However,  if  the  node 
is  busy  when  the  request  bundle  arrives,  it  passes  the  bun- 
dle to  the  next  node  (further  away  from  the  controller). 
Result  bundles,  arriving  from  the  opposite  direction,  are 
simply  passed  along  to  the  next  node  until  they  reach  the 
controller.  When  a  node  finishes  processing  a  bundle,  it 
sends  its  result  bundle  towards  the  controller. 

In  the  workfarm,  each  node  has  the  same  code,  although 
sometimes  it  may  be  desirable  to  make  minor  modifications  to 
the  end  node  code. 

The  configuration  code  for  a  workfarm  is  listed  in  Fi- 
gure 3.6.  Two  arrays  of  channels  are  declared,  one  to  carry 
the  request  bundles  out  to  the  farm  and  the  other  to  return 
the  result  bundles  back  to  the  controller.  Expanding  the 
farm  of  Transputers  is  as  easy  as  changing  the  constant 
' num. Transputers ' .  Note  that  the  controller  and  node  proces- 
ses each  have  been  "placed"  on  a  separate  Transputer,  in 
this  case  a  T414  controller  and  T800  nodes. 
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Figure  3  . 5 
Linear  Array  Workfarm 


[ num. Transputers ] CHAN  OF  ANY  requests,  results 
PLACED  PAR 

PROCESSOR  T4  100 

controller  ( requests[0 ] ,  results[0]) 
PLACED  PAR  i  =  0  FOR  num . Transputers 
PROCESSOR  T8  i 

node  ( requests [ i ] ,  requests [ i+1 ] , 
results [ i+1  ]  ,  results[i]) 


Figure  3  .  6 
Linear  Array  Workfarm  Code 
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The  controller  consists  of  four  processes  running  in 
parallel  as  shown  in  Figures  3.7  and  3.8.  Requests  and  re- 
sults are  external  channels  passed  in  by  the  global  con- 
figuration process;  all  other  channels  are  internal  to  the 
controller  and  must  be  declared. 

The  generator  initiates  the  entire  workfarm  process  by 
creating  the  request  bundles  and  passing  them  to  the  work 
router.  If  necessary,  the  generator  may  receive  inputs  from 
outside  sources  through  external  channels  to  build  the  pack- 
ets and  bundles.  The  generator  signals  the  handler  just 
before  it  begins  to  pass  out  bundles  and  is  in  turn  sig- 
nalled by  the  handler  when  the  handler  has  received  the  last 
result  bundle. 

The  work  router  and  result  router  are  essentially  buffer 
processes.  Together,  they  also  perform  a  vital  valve  func- 
tion to  make  sure  the  farm  never  exceeds  its  capacity  for 
request  bundles.  The  work  router  knows  how  many  nodes  are  in 
the  farm.  Since  each  node  has  a  buffer  enabling  it  to  hold 
two  bundles  at  a  time,  the  work  router  knows  the  farm  can 
hold  twice  as  many  request  bundles  as  the  number  of  nodes. 
It  was  necessary  to  reduce  by  one  the  farm  bundle  capacity 
known  to  the  work  router  to  avoid  overloading  the  farm. 

When  the  work  router  passes  a  bundle  to  the  farm,  it 
increments  a  counter.  When  the  results  router  receives  a 
bundle,  it  signals  the  work  router  through  the  trigger  chan- 
nel. When  the  work  router  is  signaled,  it  decrements  the 
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requests   [0] 


results    [0] 


Figure  3.7 
The  Controller 


CHAN  OF  ANY  to. router, 
CHAN  OF  ANY  to. handler 
CHAN  OF  ANY  trigger: 
PAR 

generator  (to. router 


from. router : 
from. handler 


to. handler,  from. handler ) 
work. router  (to. router,  trigger,  requests) 
results . router  ( from. router ,  trigger,  results) 
handler  ( from. router ,  to. handler,  f rom. handler ) 


Figure  3.8 
Controller  Code 
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counter.  The  work  router  will  only  accept  bundles  from  the 
generator  while  the  counter  does  not  exceed  the  farm  bundle 
capacity.  The  code  to  implement  this  valve  function  is  shown 
in  Figure  3.9. 

When  the  handler  receives  the  last  of  the  result  bundles 
it  signals  the  generator  that  the  problem  has  been  complet- 
ed. 


---  Work -router 

VAL    farm. capacity  IS  (num. Transputers  *  2)  -  1: 

BOOL   bundle. done: 

INT    count: 

SEQ 

count  : =  0 
WHILE  TRUE 
PRI  ALT 

trigger  ?  bundle. done 

count  : =  count  -  1 
(count  <=  farm o capacity )  &  to. router  ?  bundle 
SEQ 

requests  !  bundle 
count  : =  count  +  1 

-~-  Results . router 
VAL   bundle. done  IS  TRUE: 
WHILE  TRUE 
SEQ 

results  ?  bundle 
PAR 

trigger  !  bundle. done 
to. handler  !  bundle 


Figure  3 . 9 

Valve  Function  Code 

A  single  node  on  the  farm  consists  of  five  processes:  a 
work  router,  a  result  router,  a  work  buffer,  a  result  buf- 
fer, and   a  calculation  process.  A   single  node  is  shown  in 
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Figures  3.10  and  3.11.  Notice  that  the  calculation  process 
is  given  low  priority  while  the  four  communication  processes 
run  at  high  priority,  as  explained  in  Chapter  II. 


CHAN  OF  ANY    to. buffer,  to . calculation : 
CHAN  OF  ANY    from . calculation ,  from. buffer: 
CHAN  OF  BOOL   signal: 
PR I  PAR 
PAR 

work. router  ( requests . in,  requests . out , 

to. buffer, signal ) 
work. buffer  (to. buffer,  to. calculation) 
result .buffer  ( from. calculation,  from. buffer) 
result . router ( from. buffer,  results. in,  results. out 
calculation  (to. calculation,  from. calculation) 


Figure  3.10 
Single  Node  Code 

The  work  router  accepts  bundles  from  the  requests-in 
channel.  If  the  work  buffer  is  full,  the  work  router  relays 
the  bundle  to  the  next  node  in  line  by  way  of  the  requests- 
out  channel.  If  the  work  buffer  is  empty,  the  bundle  is  sent 
there  and  the  work  buffer  full  flag  is  set. 

The  work  and  result  buffers  are  present  to  decouple  the 
communication  in  the  work  and  result  router  processes  from 
the  calculation  in  the  calculation  process,  as  explained  in 
Chapter  II. 

The  work  buffer  holds  a  single  bundle  at  a  time.  When 
the  calculation  process  accepts  a  bundle  from  the  work  buf- 
fer, the  work  buffer  signals  the  work  router  that  the  buffer 
is  empty. 
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requests    [i 


requests    [i+1] 


results     I 


results    [i  +  1] 


Figure  3.11 
Single  Node 
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The  calculation  process  is  where  all  work  occurs.  There, 
upon  arrival,  a  bundle  is  separated  into  packets.  The  pack- 
ets are  processed  sequentially  and  the  results  grouped  into 
a  result  bundle.  After  the  result  bundle  has  been  passed  to 
the  result  buffer,  the  calculation  process  is  ready  to  ac- 
cept another  bundle.  Since  the  calculation  process  is  se- 
quential, it  could  be  coded  in  a  programming  language  other 
than  OCCAM  such  as  Ada,  Pascal,  or  C  and  inserted  into  the 
OCCAM  workfarm  harness. 

The  results  buffer  is  a  pure  buffer  that  relays  a  result 
bundle  to  the  result  handler  and  waits  for  another  result 
bundle  to  arrive. 

The  results  router  receives  result  bundles  either  from 
the  result  buffer  or  the  results-in  external  channel.  In 
either  case,  the  bundle  is  discharged  along  the  results-out 
channel.  An  arriving  bundle  from  the  buffer  is  given  prior- 
ity over  the  external  channel  so  that  the  calculation  pro- 
cess will  be  free  for  more  work  as  soon  as  possible. 

There  has  to  be  some  device  to  allow  for  matters  of 
initialization  and  reporting  in  the  farm.  The  method  used 
in  this  thesis  was  to  place  a  tag  at  the  head  of  every  bun- 
dle array.  Depending  on  the  tag,  a  bundle  could  be  of  the 
following  types:  setup,  data,  or  report.  Generally,  upon 
arrival  of  a  bundle,  the  tag  is  examined,  and  action  is 
taken  on  the  bundle  accordingly. 
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D.   TOPOLOGY 

A  workfarm  is  not  limited  to  the  linear  array;  trees  are 
an  attractive  option.  Because  of  communication  path  lengths, 
trees  would  seem  better  suited  for  a  workfarm  with  large 
numbers  of  Transputers.  Consider  linear  array  and  binary 
tree  workfarms,  each  with  100  farm  nodes,  for  example. 
Assuming  the  problem  was  computation  intensive  enough  so 
that  all  100  nodes  would  be  utilized,  a  bundle  would  have  to 
travel  through  99  nodes  to  get  to  the  100th  node  in  the 
linear  array.  In  the  binary  tree,  however,  a  bundle  would 
have  to  travel  through  at  most  six  nodes  to  reach  any  of  the 
100  nodes.  A  trinary  tree  would  lower  the  communication 
overhead  further.  Given  a  workfarm  of  the  same  number  of 
Transputers  working  the  same  problem,  trees  are  more  effi- 
cient than  linear  array  in  terms  of  utilizing  each  Transpu- 
ter. 

Trees  were  not  used  in  the  research  for  a  number  of 
reasons,  however.  First  of  all,  there  were  not  enough  Trans- 
puters available  to  conduct  research  and  achieve  significant 
results.  A  binary  tree  workfarm  was  implemented  but  the 
performance  gains  were  so  miniscule  that  the  author  believes 
that  significant  gains  would  not  be  realized  until  large 
numbers  of  Transputers,  perhaps  50  or  more,  were  used.  The 
modification  to  the  linear  array  workfarm  algorithm  to  ach- 
ieve binary  tree  topology  was  slight  and  only  occurred  in 
the  work  and  result  routing  processes  of  the  node  process. 
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The  actual  code  is  listed  in  Appendix  A.  Secondly,  the  BOO 3 
boards,  with  four  Transputers  each,  are  not  well  suited  to 
implementing  trees  since  half  of  the  16  links  are  hardwired. 
A  large  number  of  processors  must  be  arranged  in  a  regu- 
lar fashion  or  the  configuration  code  and  communication 
algorithms  become  too  complex.  Commonly  used  regular  struc- 
tures are  arrays  (ID,  2D,  3D,  ...),  trees  (binary,  trinary, 
etc.)/  3J^d  hypercubes .  More  complex  but  still  regular  struc- 
tures have  been  proposed  such  as  hypernet  [HwGh87].  Such 
structures  appear  promising  for  a  networks  of  large  numbers 
of  Transputers. 
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IV.   WORKFARM  PERFORMANCE 

A .   GENERAL 

The  performance  of  a  workfarm  is  dependent  on  the 
following  factors:  the  number  and  speed  of  the  Transputers, 
the  number  of  packets  in  the  problem,  the  number  of  computa- 
tions per  packet,  the  packet  size,  and  the  number  of  packets 
per  bundle »  To  determine  the  relationships  between  these 
factors  and  ultimately  the  number  of  Transputers  required  to 
complete  a  problem  in  a  certain  amount  of  time,  research  was 
conducted  on  a  standard  workfarm  using  a  variable  problem. 

B  o ■  ENVIRONMENT 

The  research  in  this  chapter  was  conducted  on  a  workfarm 
with  a  physical  configuration  as  pictured  in  Figure  4.1.  The 
number  of  Transputers  utilized  in  the  farm  portion  was  var- 
ied from  one  to  eight.  The  speed  of  an  individual  Transpu- 
ter depended  on  its  respective  type.  The  controller  process 
was  placed  on  a  remote  T414-15  Transputer.  The  T414  on  the 
B004  board  was  used  only  for  the  compiling,  extraction,  and 
loading  of  code  to  the  workfarm  network.  The  farm  nodes  were 
placed  on  T800  Transputers. 

A  B002  board  with  its  T414-15  and  RS232  interface  was 
utilized  so  that  results  could  be  displayed  to  a  VT220  ter- 
minal. The  B007  board  was  included  in  the  network  for  any 
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Figure  4.1 
Workfarm  Physical  Configuration 
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future  graphic  work.  It  acted  solely  as  a  relay  and  did  not 
figure  in  any  of  the  testing.  The  entire  workfarm  network 
ran  at  a  common  link  speed  of  20  Mbits/second  except  for  the 
B004  and  B002  boards. 

C.   TESTING  APPARATUS 

To  change  problems  on  a  workfarm  requires  modification 
of  the  calculation  process  of  the  farm  nodes,  the  generator 
process,  the  handler  process,  and  the  message  arrays  that 
pass  throughout  the  farm.  To  test  the  workfarm,  it  was  ne- 
cessary to  be  able  to  vary  the  problem  size  quickly  and 
easily.  The  problem  consisted  of  a  variable  number  of  32  bit 
floating  point  (REAL32)  multiplications  and  the  constant 
communication  overhead  of  the  workfarm  algorithm.  When  the 
farm  nodes  were  initialized,  each  farm  node  was  passed  an 
integer  representing  a  certain  number  of  calculations  per 
packet. 

The  generator  process  produced  a  certain  number  of  pack- 
ets which  were  grouped  into  bundles  and  distributed  to  the 
farm,  as  shown  in  Figure  4.2.  When  a  calculation  process  in 
the  farm  received  a  bundle,  it  simulated  separating  the 
packets  from  the  bundle  and  did  "calculation. per . packets" 
REAL32  multiplications.  The  calculation  process  simulated 
assembling  a  result  bundle  and  was  then  ready  for  the  next 
bundle.  This  testing  calculation  process  is  shown  in  Figure 
4.3. 
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tag  :=  data 

SEQ  i  =  0  for  total. bundles 
SEQ 

SEQ  j  =  1  FOR  packets .per .bundle 
[bundle  FROM  (j  TIMES  4)  FOR  4] 
[dummy .array  FROM  0  FOR  4] 
requests  !  bundle 


Figure  4.2 
Generator  Process  Code 


SEQ  i  =  1  FOR  packets .per .bundle 
SEQ 

[dummy .array  FROM  0  FOR  4]  := 
[bundle. in  FROM  (i  TIMES  4)  FOR  4] 
SEQ  j  =  0  FOR  calcs. per .packet 

X  :=  x*x 
SEQ  j  =  0  FOR  4 

bundle. out  [ j ]  :=  dummy (BYTE) 


Figure  4.3 
Calculation  Process  Code 
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A  timer  was  started  preceding  the  initialization  phase. 
When  the  handler  process  received  the  last  result  bundle  the 
problem  was  completed  and  the  timer  was  stopped.  The  time 
required  to  complete  the  entire  problem  was  simply  the  stop 
time  minus  the  start  time. 

During  the  report  phase,  the  handler  received  packets 
from  the  farm  nodes  that  contained  the  number  of  bundles 
that  each  node  processed  and  the  node  identification.  The 
handler  passed  this  information  and  the  problem  completion 
time  to  the  VT220  terminal  for  display. 

The  bundle  used  for  communication  in  the  workfarm  con- 
sisted of  an  array  of  bytes.  The  first  four  bytes  were  re- 
typed to  represent  the  integer  tag.  The  next  eight  bytes 
were  retyped  into  a  setup  array  of  two  integers  to  hold 
initialization  values.  When  the  bundles  were  used  in  their 
normal  role  of  carrying  packets,  they  were  essentially 
"dummy"  arrays,  as  the  only  meaningful  information  in  each 
bundle  was  the  tag.  Figure  4.4  lists  the  bundle  declaration. 


VAL  packets. per .bundle 

IS  10000/total. bundles: 

VAL  bundle. size 

IS  packets .per .bundle  +  1: 

VAL  packet .size. int 

IS  1: 

VAL  bundle. size. byte 

IS  bundle. size. int  TIMES  4: 

VAL  packet . size. byte 

IS  packet .size. int  TIMES  4: 

[ bundle . size ] BYTE 

bundle: 

INT    tag 

RETYPES  [bundle  FROM  0  FOR 

4]: 

[]INT   setup. array 

RETYPES  [bundle  FROM  4  FOR 

8]: 

Figure  4.4 
Bundle  Declaration 
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The  packet  size  used  for  the  research  was  one  integer. 
This  represented  a  unit  packet  with  four  byte-size  para- 
meters. Most  problems  will  have  packets  consisting  of  some 
multiple  of  four  bytes;  for  example,  the  Mandelbrot  Set 
problem  has  12  byte  request  packets  and  32  byte  result  pack- 
ets . 

D.   RESULTS  AND  CONCLUSIONS 

Figure  4.5  illustrates  some  of  the  relationships  that 
exist  in  an  eight  Transputer  workfarm  among  the  many  vari- 
ables that  affect  performance.  The  vertical  axis  shows  the 
time  to  calculate  10,000  packets.  The  horizontal  axis  indi- 
cates the  number  of  REAL32  multiplications  each  packet 
represents.  If  calculations .per .packet  is  100,  the  total 
workload  is  1,000,000  REAL32  multiplications. 

Each  line  of  the  graph  represents  a  different  bundle 
size,  in  terms  of  packets  per  bundle.  For  example,  a  bundle 
made  up  of  16  packets  is  17  integers  long  (68  bytes):  16  one 
integer  packets  and  a  one  integer  tag. 

Each  line  begins  flat  and  at  some  point  begins  increas- 
ing linearly.  The  flat  line  indicates  two  things.  While  the 
line  is  flat,  not  all  eight  Transputers  are  being  utilized. 
For  small  bundles  of  one  packet  per  bundle,  the  farm  is 
underutilized  until  the  workload  reaches  120  calculations 
per  packet.  As  the  bundle  size  increases,  more  Transputers 
are  utilized  sooner.  For  example,  at  16  packets  per  bundle. 
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Figure  4.5 
Workfarm  Performance  Characteristics 
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the  workfarm  is  fully  utilized  at  approximately  30  calcula- 
tions per  packet. 

The  flat  line  also  means  that  the  workfarm  is  completing 
an  increasing  number  of  calculations  with  no  corresponding 
increase  in  time.  This  is  explained  by  observing  how  many 
Transputers  were  utilized  at  each  calculation  point.  As  the 
workload  increased,  the  workfarm  utilized  more  of  its  avail- 
able processors.  Of  course,  there  came  a  time  when  all 
available  Transputers,  in  this  case  eight,  were  in  use.  From 
then  on,  the  time  required  increased  proportionally  to  the 
increase  in  the  workload. 

Once  all  the  farm  Transputers  were  in  use,  and  the  work- 
load continued  increasing,  the  time  increased  at  a  constant 
rate.  This  rate  was  equal  for  all  bundle  sizes. 

The  question  of  time  to  complete  a  problem  can  best  be 
represented  by  the  following  equation: 

time  :=  (calcs .per .packet  *  total .packets )  +  comm.ovhd 

With  a  small  number  of  calculations  per  packets,  the  com- 
munication overhead  is  a  significant  factor  in  the  equation. 
As  the  workload  increases,  the  communication  overhead  de- 
creases in  significance. 

The  time  required  to  complete  the  problem  decreased  as 
the  bundle  size  grew.  At  greater  than  16  packets  per  bundle, 
however,  the  time  reductions  became  negligible.  This  was  not 
surprising,   considering  that  with  one  packet  per  bundle. 
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half  of  the  bundle  was  used  for  communication  overhead  (one 
integer  for  the  tag,  one  integer  for  the  packet).  At  16 
packets  per  bundle,  however,  1/17  of  the  bundle  was  over- 
head, or  5.9  percent.  Between  one  packet  per  bundle  and  16 
packets  per  bundle  there  was  a  large  difference  in  the  over- 
head percentage;  the  reductions  in  time  was  correspondingly 
great.  The  overhead  percentage  difference  between  16  and  32 
packets  per  bundle  was  small,  however,  and  the  reduction  in 
time  required  was  also  correspondingly  small. 

In  each  farm  node  process,  one  bundle  is  declared  in 
each  of  the  four  communication  processes  and  two  bundles  are 
declared  (bundle. in  and  bundle. out)  in  the  calculation  pro- 
cess. Sixteen  packets  per  bundle  (17  integers)  is  a  good 
bundle  size  since  the  bundle  is  large  enough  to  yield  near 
optimal  performance  yet  small  enough  to  require  little  on- 
chip  memory.  Bundle  sizes  greater  than  667  bytes  will  leave 
no  room  on  the  T800  on-chip  memory  for  any  other  data  struc- 
tures because  six  bundle  arrays  will  require  4002  bytes  of 
memory  which  is  close  to  the  T800  on-chip  memory  capacity  of 
4096. 

With  100  calculations  per  packet  and  10,000  packets,  the 
total  workload  is  1,000,000  REAL32  multiplications  plus  the 
communication  overhead.  Dividing  the  workload  by  the  total 
time  to  complete  the  workload  yields  "workfarm  mega-floating 
point  operations  per  second"  (WF-MFLOPS).  Plotting  WF-MFLOPS 
versus  number  of  Transputers  yields  the  graph  in  Figure  4.6. 
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Figure  4.6 
Linear  Performance 

The  resulting  nearly  straight  line  indicates  that  the  work- 
farm  is  achieving  near  linear  performance;  that  is  to  say, 
WF-MFLOPS  is  directly  proportional  to  the  number  of  Trans- 
puters in  the  farm. 

It  should  be  realized  that  at  some  number  of  Transpu- 
ters, the  line  in  Figure  4.6  will  turn  sharply  horizontal. 
Where  on  the  graph  this  occurs  depends  on  the  workload  and 
number  of  Transputers.  It  represents  the  point  at  which  the 
controller  cannot  provide   request   bundles   fast   enough  to 
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keep  all  the  farm  nodes  busy.  Adding  more  Transputers  to  the 
farm  beyond  this  point  is  wasteful,  since  no  further  in- 
crease in  work  capacity  can  ever  occur. 

It  would  be  helpful  to  be  able  to  predict  either  how 
many  Transputers  in  a  farm  are  needed  to  solve  a  problem  in 
a  certain  amount  of  time  or  how  long  a  problem  will  take 
given  a  certain  number  of  farm  Transputers.  To  do  so,  one 
has  to  realize  that  a  workfarm  can  be  in  one  of  two  limiting 
conditions,  depending  on  the  workload  and  number  of  Transpu- 
ters. The  first  case  is  when  the  workfarm  is  "calculation 
limited";  that  is,  the  ultimate  performance  is  limited  by 
the  workload,  not  by  the  controller  request  bundle  genera- 
tion rate.  The  second  case  is  when  the  workfarm  is  "com- 
munication limited";  with  small  workloads,  the  farm  nodes 
are  able  to  complete  request  bundles  faster  than  the  con- 
troller can  supply  them. 

The  workfarm  performance  can  be  characterized  by  a  set 
of  equations  using  the  notation  in  Table  4.1.   Figure  4.7  is 
provided  as  a  reference. 
The  time  to  solve  a  problem  on  a  workfarm  (T)  is  obviously 


T  .  N 

r 


And,  since  r  ^  m. 


T  =  ^  >  ^ 
r  "  m' 
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TABLE  4 . 1 
WORKFARM  VARIABLES 


Variable              Represents 

B       i   single  node  maximum  calculation  rate  - 

;   bundles/second  with  no  degradation        i 

r          controller  limiting  rate  -  bundles/second  \ 

m 

controller  maximum  rate  -  bundles/second 

^i 

bundles/second  accepted  by  node  i  for 
calculation 

T 

time  to  solve  complete  problem 

N 

total  number  of  bundles  in  problem 

n 

total  number  of  nodes  in  farm 

Dx 

degradation  of  B  caused  by  x 
bundles /second 

Figure  4.7 
Workfarm  Reference 
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with  n  farm  nodes,  each  node  accepts  the  following 
number  of  bundles  per  second  for  calculation: 


ao  =  B 


a]_  =  B  •  D 

32  =  B  •  D 
^        an+a 


^0 


Thus, 


a   ,  =  B  •  D 

n-1        aQ  +  a]_+.  .  .+a  ^^ 


m  >  r  =  ^2?;  ai 
1=0   1 


The  total  number  of  bundles  (N)  in  a  problem  is  a  known 
factor  that  can  be  used  for  predictions.  The  rate  that  bun- 
dles can  be  accepted  and  processed  by  a  single  Transputer 
node  without  degradation  (B)  can  also  be  determined  before- 
hand by  measuring  the  maximum  number  of  bundles  that  a  sin- 
gle farm  Transputer  can  process  in  a  certain  time  period. 

Consider  the  calculation  limited  workfarm,  which  is 
characterized  by  a  large  workload.  There  are  two  predictions 
that  can  be  made.  First  of  all,  if  there  is  a  certain  number 
of  Transputers  available,  one  can  determine  how  long  it  will 
take  to  complete  the  problem.  Secondly,  if  one  has  a  time 
limit  in  which  to   complete  the  problem,  one   can  determine 
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how  many  Transputers  will  be  required,  assuming  the  problem 
does  not  become  controller  limited. 

Research  showed  that  when  the  farm  was  calculation  limi- 
ted, each  farm  node  processed  approximately  the  same  number 
of  bundles,  with  a  slight  increase  in  processed  bundles  from 
first  to  last  node.  This  corresponds  to  the  decreasing  de- 
gradation in  the  farm  as  the  nodes  further  from  the  con- 
troller have  to  route  less  and  less  bundles.  If  the  number 
of  Transputers  (n)  is  known,  and  relatively  few  Transputers 
are  used,  the  number  of  bundles  processed  by  each  farm  node 
is  approximately  N  -;■  n  or  Nj_.  Since  aj_  is  approximately  the 
same  for  each  node  (discounting  degradation)  and  the  farm  is 
calculation  intensive,  the  overall  time  required  by  one  node 
to  complete  Nj^  bundles  can  be  assumed  to  be  approximately 
the  same  as  the  overall  time  taken  to  complete  the  entire 
problem.  This  simple  method  to  predict  the  overall  time  of  a 
computation  limited  workfarm  was  effective  to  within  five 
percent  of  the  actual  results.  The  resulting  equation  is: 

T  =    N 


n«B' 


To  complete  the  problem  in  a  given  amount  of  time,  one 
can  calculate  approximately  how  many  Transputers  will  be 
required  by  merely  switching  T  and  n  in  the  above  equation: 


N 
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The  communication  limited  case  is  characterized  by  a  low 
workload  with  the  farm  nodes  accepting  request  bundles  at  a 
greater  rate  than  in  the  calculation  limited  case.  Obvious- 
ly, the  more  request  bundles  accepted,  the  more  result  bun- 
dles generated;  and  in  general,  a  greater  percentage  of 
processor  time  is  spent  passing  bundles.  The  lower  the  work- 
load, the  sooner  the  farm  will  be  able  to  exceed  the  con- 
troller's ability  to  supply  bundles.  If  the  first  few  farm 
nodes  can  match  the  rate  at  which  the  request  bundles  come 
from  the  controller,  then  nodes  further  down  the  line  in  the 
farm  simply  will  not  receive  any  work.  Thus,  the  controller 
generation  rate  becomes  the  limiting  factor  as  r  decreases 
from  m.  This  generation  rate  includes  the  overhead  caused  by 
the  controller  having  to  accept  incoming  result  bundles.  The 
number  of  nodes  in  the  farm  that  do  useful  work  is  dependent 
on  the  capacity  of  the  controller  to  supply  request  bundles . 

It  would  be  useful  to  know  at  what  point  a  particular 
problem  becomes  communication  limited;  that  is,  for  any 
problem,  what  is  the  maximum  number  of  nodes  in  the  farm 
that  will  do  useful  work.  The  workload  and  total  number  of 
bundles  are  known  from  the  problem  description.  A  rough 
estimation  may  be  reached  by  assuming  that  at  equilibrium, 
where  some  number  of  farm  nodes  are  able  to  match  the  con- 
troller's request  bundle  generation  rate  (r),  each  working 
node  is  processing  approximately  the  same  number  of  bundles. 
Dividing  r   by  the   single  node  maximum  calculation  rate  (B) 
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yields  the  approximate  number  of  nodes  that  will  do  useful 
work.  Unfortunately,  r  is  difficult  to  ascertain  without 
implementation  and  testing.  An  upper  bound  may  be  obtained 
by  substituting  m  for  r.  By  testing  on  a  workfarm  with  a 
single  farm  node,  as  shown  in  Figure  4.8,  m  can  be  deter- 
mined. The  single  workfarm  node  merely  accepts  request  bun- 
dles and  returns  to  the  controller  a  simulated  result  bundle 
without  doing  any  calculations.  Thus  an  upper  bound  for  the 
controller  capacity  is  easily  measured. 


controller 


requests 


results 


Figure  4.8 
Single  Farm  Node  Test 
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Figure  4.9  shows  the  actual  controller  request  bundle 
generation  rate  (r)  versus  increasing  workload  for  a  farm 
consistina  of  15  T414  nodes. 
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Figure  4.9 
Controller  Request  Bundle  Generation  Rate 

The  initial  rate  versus  a  workload  of  zero  is  a  high 
8000  bundles  per  second.  This  zero  workload  rate,  converted 
to  550  Kbytes  per  second,  approaches  the  theoretical  maximum 
unidirectional  link  rate  of  a  T414,  750  Kbytes  per  second, 
and  is   in  fact   m.  The   zero  workload  rate  will  never  match 
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the  theoretical  maximum  rate  because  of  the  controller  over- 
head. When  a  load  is  put  on  the  farm,  the  actual  rate  drops 
off  sharply  to  approximately  5700  bundles  per  second  and 
then  decreases  gently  at  a  nearly  constant  rate  of  approxi- 
mately 100  rate  units  per  workload  unit.  This  rate  holds 
until  the  farm  begins  to  become  calculation  limited  and  the 
rate  drops  sharply  again. 

Since  r  is  relatively  constant  during  the  communication 
limited  portion  of  the  graph,  it  can  be  used  in  the  follow- 
ing rule  of  thumb  equation  for  determining  the  maximum  num- 
ber of  useful  farm  Transputers  in  a  communication  limited 
workfarm: 


Transputer  limit  =  ^. 


B 


Again,  m  can  be  substituted  for  r  in  this  equation  to  deter- 
mine an  upper  bound  on  the  number  of  Transputers  a  par- 
ticular workload  will  utilize.  Determining  r  accurately 
without  testing  the  actual  problem  on  a  farm  of  multiple 
Transputers  was  a  difficult  problem.  The  only  success  in 
obtaining  an  approximate  value  of  r  was  to  test  the  actual 
problem  on  a  farm  of  at  least  four  Transputers.  The  result- 
ing r  value  could  then  be  used  to  project  a  Transputer  limit 
for  problems  with  larger  workloads.  The  validity  of  this 
projection  is  a  function  of  the  accuracy  of  r  and  B. 


45 


Any  time  the  number  of  Transputers  in  the  farm  is  less 
than  r  -5-  B,  those  Transputers  are  going  to  be  fully  util- 
ized, each  processing  approximately  N  ■=-  n  bundles. 
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V.   PREDICTIONS 

A .  GENERAL 

The  research  conducted  in  Chapter  IV  can  be  used  to 
predict  the  performance  of  the  workfarm  in  some  cases.  Two 
different  problems  are  used  in  this  chapter  as  examples: 
coordinate  transformation  and  Mandelbrot  set  drawing.  Actual 
performance  results  from  these  two  problems  were  compared 
with  the  predictions. 

B.  COORDINATE  TRANSFORMATION  PROBLEM 

This  coordinate  transformation  problem  originated  from 
research  for  a  autonomous  walking  machine  [Ri87].  The  fol- 
lowing is  a  brief  description  of  the  problem  and  its  im- 
plementation on  a  workfarm.  For  in-depth  coverage  of  the 
problem  itself,  the  reader  is  referred  to  [Ri87]. 

An  autonomous  land  vehicle,  known  as  the  Adaptive  Sus- 
pension Vehicle,  possesses  an  optical  radar  scanner  which 
the  vehicle  uses  to  "see"  the  forward  terrain.  The  scanner 
returns  range  measurements  for  each  elevation  and  azimuth 
increment  in  its  scan.  A  single  scan  consists  of  128  azimuth 
increments  for  each  of  128  elevation  increments,  a  total  of 
16,384  iterations.  The  azimuth,  elevation,  and  range  are 
combined  with  six  other  inputs  from  the  vehicle's  inertial 
navigation  system  to  develop  a  cartesian  coordinate  position 
of   the   particular   scanned   point.   The  elevation  of  every 
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point  in   the  scan   is  kept   in  a  terrain  matrix  data  struc- 
ture. 

For  the  workfarm  implementation,  each  packet  represented 
one  scan  iteration  and  consisted  of  three  bytes  representing 
the  scanner  azimuth  angle,  the  scanner  elevation  angle,  and 
the  resulting  range.  There  were  16  384  packets  in  one  scan. 

The  vehicle's  inertial  navigation  system  (INS)  supplied 
the  vehicle  attitude  and  position  information,  for  a  total 
of  six  inputs.  The  attitude  information  consisted  of  the 
vehicle's  azimuth  angle,  pitch  angle,  and  roll  angle.  The 
positional  information  consisted  of  the  vehicle's  x,  y,  and 
z  transformation  (distance)  from  the  INS  reference  point. 
Because  these  six  inputs  remained  constant  for  the  entire 
scan,  they  could  be  passed  to  the  farm  and  processed  as  much 
as  possible  during  the  initialization  phase  of  the  workfarm. 

The  radar  scanner  was  easily  implemented  on  a  separate 
"scanner"  process.  Byte  range  values  for  a  flat,  zero  eleva- 
tion scan  were  calculated  ' and  then  sequentially  passed  to 
the  controller  process  through  a  channel.  Although  not  im- 
plemented, the  rate  of  outgoing  range  values  could  be  easily 
controlled  through  use  of  the  Transputer  timer. 

Each  of  the  16384  packets  in  a  single  scan  were  proces- 
sed in  the  following  way.  Each  byte  in  the  packet  was  first 
hashed  into  a  useful  32-bit  floating  point  real  number 
(REAL32).  For  example,  the  scanner  azimuth  range  was  -40  to 
+40  degrees.  Since  a  byte  can   only  represent   the  numbers  0 
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to  255,  the  scanner  azimuth  byte  had  to  be  converted  into 
the  correct  data  upon  arrival  in  a  farm  node.  Each  bundle 
contained  a  byte  tag  and  128  packets. 

For  each  packet  the  three  new  parameters  were  combined 
with  the  six  parameters  received  during  the  initialization 
phase  using  a  Denavit-Hartenberg  (D-H)  transformation  to 
yield  the  x,  y,  and  z  coordinates  of  the  particular  spot 
being  scanned  [Ri87].  These  three  coordinates  were  themsel- 
ves converted  into  bytes,  loaded  into  the  result  bundle,  and 
eventually  passed  back  to  the  controller. 

The  problem  was  implemented  on  a  standard  workfarm  as 
described  in  Chapters  III  and  IV;  that  is,  the  controller 
process  was  placed  on  a  T414-15  and  eight  farm  nodes  were 
placed  on  eight  TBOOs.  The  scanner  process  was  placed  on  a 
separate  T414-15  and  shared  a  single  link  with  the  con- 
troller process.  The  calculation  process  of  a  farm  node  is 
listed  in  Appendix  C. 

Testing  on  a  single  T800  Transputer  yielded  an  ap- 
proximate calculation  rate  (B)  of  4  3.63  bundles  per  second. 
Total  bundles  for  one  scan  (N)  was  128. 

The  actual  time  for  the  workfarm  to  process  a  single 
scan  (T)  was  0.427  seconds,  including  loading  the  resultant 
16384  altitude  values  into  a  terrain  map  matrix.  The  farm 
was  controller  limited,  with  6 . 3  of  the  8  Transputers  being 
utilized . 
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The  actual  controller  request  bundle  flow  rate  (r)  was 
300  bundles  per  second.  If  this  value  of  r  could  have  been 
estimated  correctly  beforehand,  the  predicted  Transputer 
limit  for  this  problem  would  have  been  r  divided  by  B  or  6.9 
Transputers.  This  is  very  close  to  the  6.3  Transputers  that 
were  actually  utilized. 

C.   MANDELBROT  SET 

The  drawing  of  the  Mandelbrot  Set  is  a  problem  that 
demonstrates  the  best  qualities  of  the  workfarm.  It  is  a 
problem  that  is  extremely  computation  intensive  and  where 
the  amount  of  work  each  packet  will  entail  is  unknown. 

For  an  in  depth  description  of  the  Mandelbrot  Set  pro- 
blem, the  reader  is  directed  to  [Po86];  this  chapter  mainly 
discusses  implementation  and  performance. 

Essentially,  the  Mandelbrot  set  is  generated  by  iterating 
a  simple  function  on  the  points  of  the  complex  plane.  The 
points  that  produce  a  cycle  (the  same  value  over  and  over 
again)  fall  in  the  set,  whereas  the  points  that  diverge 
(give  ever-growing  values)  lie  outside  it.  When  plotted  on 
a  computer  screen  in  many  colors  (different  colors  for 
different  rates  of  divergence),  the  points  outside  the  set 
can  produce  pictures  of  great  beauty.  [Po86] 

The  problem  is  divided  into  independent  work  packets; 
each  packet  containing  an  integer  tag  and  two  other  integers 
that  represent  a  coordinate  position  on  the  complex  plane. 
As  stated  before,  the  packet  workload  is  variable;  there  is 
no  way  of  knowing  beforehand  how  much  calculation  each  pack- 
et will  require.  Each  packet  really  represents  16  coor- 
dinates because  the  farm  node  uses  the  single   coordinate  in 
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the  packet  as  the  starting  point  for  15  more  consecutive 
horizontal  coordinates.  Each  iteration  can  entail  from  one 
to  256  loops  of  approximately  ten  arithmetic  operations 
each. 

A  factor  in  this  particular  problem  is  that  the  handler 
in  the  controller  has  to  pass  result  bundles  to  the  graphics 
routine  on  the  BOOT  graphics  board  where  the  results  are 
drawn.  The  controller  flow  rate  (r)  is  lowered  because  of 
this  overhead . 

The  implementation  of  the  Mandelbrot  set  onto  the  work- 
farm  is  somewhat  different  than  in  previous  implementations. 
There  is  no  benefit  in  bundling  together  packets  to  improve 
communication  efficiency  because  of  the  variable  packet 
workload.  A  request  packet  is  already  fairly  large,  12 
bytes,  and  a  result  packet  is  even  larger,  32  bytes.  Both 
request  and  result  packets  represent  16  coordinate  points 
which  can  represent  a  massive  amount  of  computation. 

The  generator  and  handler  processes  of  the  controller 
and  the  calculation  process  of  the  farm  node  are  listed  in 
Appendix  D. 

The  problem  was  implemented  on  the  same  workfarm  con- 
figuration as  the  coordinate  transformation  problem  with  the 
exception  of  the  scanner. 

The  coordinate  matrix  was  512  by  512;  thus  there  were 
16384  packets  (N) ,  each  representing  16  horizontal  coor- 
dinates as  stated  before. 
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when  each  coordinate  only  required  one  loop  iteration,  a 
solid  dark  gray  screen  was  drawn  in  1.5  seconds.  The  farm 
was  controller  limited  as  only  3.2  of  the  8  Transputers  were 
utilized.  When  each  coordinate  required  256  iterations,  the 
workfarm  required  81.5  seconds  to  draw  a  solid  black  screen. 
The  farm,  of  course,  was  computation  limited  and  all  eight 
Transputers  were  utilized  with  only  a  slight  variation  in 
the  number  of  packets  processed  by  each. 

Because  the  packet  workload  is  variable,  predictions  are 
possible  only  when  each  coordinate  represents  the  same  a- 
mount  of  loop  iterations;  i.e.,  the  screen  is  solid  black 
(256  iterations  per  coordinate)  or  solid  dark  gray  (one 
iteration  per  coordinate) . 

Testing  on  a  single  T800  Transputer  yielded  an  ap- 
proximate calculation  rate  (B)  of  39  packets  per  second. 
Using  this  value  in  the  calculation  limited  equation  to 
predict  the  actual  time  to  draw  a  solid  black  screen  on  a 
farm  of  eight  T800  Transputers  yielded  52.5  seconds.  As 
noted  previously,  however,  the  actual  time  was  81.5  seconds. 
This  discrepancy  arose  because  the  controller  was  limiting 
the  farm  although  the  problem  was  still  calculation  limited. 
The  controller  limited  the  farm  because  the  controller's 
handler  had  to  send  every  results  packet  to  the  graphics 
Transputer  for  drawing.  This  caused  the  controller  to  wait 
because  the  graphics  process  would  not  accept  another  packet 
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until  the  previous  one  had  been  completed  (drawn).  This 
waiting  translated  into  significant  overhead. 

The  actual  problem  was  again  tested,  this  time  without 
the  controller  handler  having  to  pass  results  to  the  gra- 
phics Transputer  (no  picture  was  drawn);  the  controller 
handler  merely  accepted  results  from  the  farm.  The  actual 
time  in  this  case  was  approximately  53  seconds,  very  close 
to  the  original  prediction. 

Clearly,  the  equations  do  not  work  if  the  controller  has 
to  do  work  on  the  results  after  reception.  In  this  case,  for 
the  equations  to  remain  applicable,  the  controller  handler 
needs  to  relay  work  to  a  buffer  Transputer  between  the  con- 
troller and  the  graphics  Transputer  (for  example).  Or,  if 
much  work  of  a  different  type  is  needed,  the  results  could 
be  passed  to  another,  separate  farm. 
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VI.   CONCLUSIONS  AND  RECOMMENDATIONS 

A.  CONCLUSIONS 

This  thesis  deals  primarily  with  the  work  distribution 
algorithm  known  as  workfarm.  Although  limited  to  problems 
divisible  into  independent  work  packets,  it  is  a  simple  yet 
extremely  effective  way  of  processing  in  parallel  and  achie- 
ving near  linear  performance  speedups .  Processing  rapid 
streams  of  data  from  a  weapon  system  sensor  would  seem  to 
fall  into  the  workfarm  category  of  problems.  The  coordinate 
transformation  example  demonstrates  that  the  workfarm  is 
well  suited  for  a  radar  problem. 

B.  RECOMMENDATIONS 

Although  the  equations  for  workfarm  performance  have 
been  developed  in  this  thesis,  research  on  how  to  accurately 
estimate  the  controller  request  bundle  flow  rate  for  a  farm 
of  a  given  number  of  Transputers  and  given  workload  needs  to 
be  done  to  predict  the  limit  at  which  a  farm  becomes  con- 
troller limited.  For  the  same  reason,  research  is  needed  to 
accurately  estimate  the  degradation  factor  for  each  node  in 
the  farm. 

Both  the  pipeline  and  workfarm  are  good  for  specific 
types  of  problems;  however,  much  work  remains  in  developing 
and  evaluating  new  work   distribution   algorithms   for  other 
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kinds  of  problems.  Specifically,  [HwCh87]  appears  promising 
as  a  source  for  new  work  distribution  algorithms. 

Much  work  remains,  too,  in  development  and  evaluation  of 
new  network  physical  topologies.  For  example,  in  a  workfarm, 
a  simple  binary  tree  farm  topology  would  allow  a  controller 
to  supply  the  farm  with  a  far  greater  rate  of  request  bun- 
dles than  it  could  to  a  linear  array  farm.  Other  topologies, 
such  as  hypernet  [HwGh87],  would  be  extremely  interesting  to 
implement.  Currently  there  are  too  few  Transputers  in  the 
lab  to  significantly  explore  these  different  topologies; 
perhaps,  more  topology  research  can  be  done  when  greater 
numbers  of  Transputers  are  available.  The  relative  ease  to 
configure  multi-Transputer  networks  by  virtue  of  the  OCCAM 
programming  language  makes  widespread  research  in  network 
topology  practical  for  the  first  time. 

An  ADA  compiler  will  be  available  for  the  Transputer 
family  soon;  since  ADA  is  the  Department  of  Defense  standard 
programming  language,  research  on  the  implementation  of  Ada 
on  Transputers  should  begin  as  soon  as  the  compiler  arrives . 

The  ultimate  goal  of  an  ongoing  series  of  Transputer 
theses  at  the  U.S.  Naval  Postgraduate  School,  of  which  this 
thesis  is  part,  is  to  develop  an  alternative  computer  ar- 
chitecture for  the  U.S.  Navy  Aegis  Combat  System.  The  exper- 
tise base  represented  by  this  series  of  theses  has  reached 
the  point  where  the  next  step  should  be  the  simulation  of 
the   AN/SPY-IA   3D   Phased   Array  Radar  Controller,  the  main 
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component  of  the  Aegis   Combat  System.  It  seems  likely  that 
the  workfarm  would  have  some  utility  in  such  a  simulation. 

One  fact  stands  out  from  working  with  Transputers :  the 
Transputer  system  is  revolutionary.  Its  performance  jump 
over  anything  short  of  a  supercomputer  is  orders  of  mag- 
nitude »  True  parallel  processing  is  implemented  easily  with 
a  high  level  programming  language,  employing  the  best  ele- 
ments of  software  engineering.  The  Transputer  system  seems 
especially  useful  for  the  military,  considering  the  Transpu- 
ters suitability  for  embedded  control  applications  and  par- 
allel processing  networks. 
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APPENDIX  A 

BINARY  TREE  WORKFARM  SOURCE  CODE 

The  only  difference  between  the  binary  tree  and  the 
linear  array  workfarms  occurs  in  the  request  and  result 
routers  of  the  farm  node.  To  keep  the  program  compact,  two 
separate  versions  of  the  farm  node  were  developed,  a  fork 
node  and  a  leaf  node.  That  is  all  that  is  listed  in  this 
appendix.  The  complete  algorithm  for  a  linear  array  workfarm 
is  in  Appendix  B. 


PROC  fork (CHAN  OF  ANY    requests. in,  requests . out . left , 

requests . out . right , 
results . in . left ,  results . in . right , 
results .out, 
VAL  INT         proc.id) 

CHAN  OF  ANY   from. result . router ,  signal: 
CHAN  OF  ANY   to. buffer,  to . calculation: 
CHAN  OF  ANY   from. buffer,  from. calculation: 

PR  I  PAR 
PAR 

VAL  left  IS  FALSE: 
VAL  right  IS  TRUE: 
. . .  communication 
. . .  calculation 
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fork  request  router 


declarations 

[bundle. size] BYTE  bundle: 

INT     tag  RETYPES    [bundle  FROM  0  FOR  4]: 

BOOL   d .buffer .empty ,  switch: 

INT    num. left,  num. right: 


SEQ 

initialization 

d. buffer .empty  : 

:=  TRUE 

IF 

proc.id  =  0 

SEQ 

num. left 

:=  6 

num. right 

:=  6 

proc.id  >  0 

SEQ 

num. left 

:=  2 

num. right 

:=  2 

WHILE  TRUE 
PRI  ALT 
ALT 

s ignal  ?  d . buffer . empty 

SKIP 
from. result . router  ?  switch 
IF 

switch  =  left 

num. left  :=  num. left  +  1 
switch  =  right 

num. right  :=  num. right  +  1 
requests. in  ?  bundle 
IF 

tag  =  data 
IF 

d .buffer .empty 
SEQ 

d. buffer .empty  :=  FALSE 
to. buffer  !  bundle 
else 
IF 

num. left  >=  num. right 
SEQ 

num. left  :=  num. left  -  1 
requests . out . left  !  bundle 
else 
SEQ 

num. right  :=  num. right  -  1 
requests . out . right  !  bundle 
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tag  =  setup 
PAR 

requests .out . left  !  bundle 
requests . out . right  !  bundle 
to. buffer  !  bundle 

tag  =  report 
PAR 

requests .out .left  !  bundle 
requests .out . right  !  bundle 
to. buffer  !  bundle 


fork  result  router 


[bundle. size] BYTE  bundle: 
WHILE  TRUE 
PRI  ALT 

from. buffer  ?  bundle 

results. out  !  bundle 
results . in. left  ?  bundle 
PAR 

from. result . router  !  left 
results. out  !  bundle 
results . in. right  ?  bundle 
PAR 

from. result . router  !  right 
results. out  !  bundle 
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PROC  leaf (CHAN  OF  ANY     requests. in,  results. out, 
VAL  INT         proc.id) 

CHAN  OF  ANY   signal: 

CHAN  OF  ANY   to. buffer,  to . calculation : 
CHAN  OF  ANY   f rom . buf f er ,  from. calculation: 
PRI  PAR 

PAR 

. . .  communication 

. . .  calculation 


leaf  request  router 

---  declarations 

[bundle. size]BYTE  bundle: 

INT      tag  RETYPES    [bundle  FROM  0  FOR  4] 

BOOL     d .buf fer. empty : 

SEQ 

d« buffer .empty  :=  TRUE 
WHILE  TRUE 
PRI  ALT 

signal  ?  d .buffer .empty 

SKIP 
requests. in  ?  bundle 
IF 

tag  =  data 
IF 

d. buf fer .empty 
SEQ 

d. buf fer .empty  :=  FALSE 
to. buf fer  !  bundle 
else 
SKIP 

tag  =  setup 

to. buffer  !  bundle 

tag  =  report 

to. buffer  !  bundle 


leaf  result  router 

[bundle. size] BYTE   bundle: 
WHILE  TRUE 
SEQ 

from. buffer  ?  bundle 

results. out  !  bundle 
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APPENDIX  B 
GENERIC  WORKFARM  SOURCE  CODE 


global  variable  file 

VAL  MAXnumTS  IS 

VAL  total. bundles      IS 

VAL  total. packets      IS 

VAL  packets .per .bundle  IS 

VAL  bundle. size. int    IS 


VAL  packet .size. int 

VAL  base.calc 

VAL  calc. loops 

VAL  bundle. size 

VAL  packet. size 

VAL  farms I ZE 

VAL  workSIZE 

VAL  data 

VAL  setup 

VAL  report 

VAL  else 


8: 

625: 

10000: 

total . packets/total . bundles 
packets .per . bundle  +  1: 


IS 

1: 

IS 

10: 

IS 

10: 

IS 

bundle. size. int 

TIMES  4 

IS 

packet. size. int 

TIMES  4 

IS 

MAXnumTS : 

IS 

(farmSIZE  TIMES 

2)  -  1: 

IS 

1: 

IS 

2: 

IS 

3: 

IS 

TRUE: 

PROC  root (CHAN  OF  ANY  to. graph,  from. graph,  requests, 

results ) 

internal  channels 

CHAN  OF  ANY   to. handler,  from. handler , 

to. router,  from. router, 

trigger: 

PAR 

generator (to. router ,  to. handler,  f rom. handler ) 
work. router (to. router ,  trigger,  requests) 
results . router ( from. router ,  trigger,  results) 
handler ( from. router ,  to. handler,  f rom. handler ,  to. graph, 
from. graph) 
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PROC  node (CHAN  OF  ANY     requests. in,  requests . out , 

results. in,  results. out, 
VAL  INT         proc.id) 

---  internal  channel  declarations 
CHAN  OF  ANY        to. buffer,  to . calculation : 
CHAN  OF  ANY        from . calculation,  from. buffer : 
CHAN  OF  BOOL       signal: 

PR I  PAR 
PAR 

. . .  request  router 
.  . .  request  buffer 
.  .  .  result  buffer 
.  .  .  result  router 
.  . .  calculation 
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PROC  generator (CHAN  OF  ANY  to. router,  to. handler, 

from. handler ) 

declarations 

[bundle. sizeJBYTE        bundle: 

INT      tag  RETYPES   [bundle  FROM  0  FOR  4]: 

[]INT    setup. array     RETYPES   [bundle  FROM  4  FOR  8]: 
INT      any : 

SEQ  calcs .per .packet  =  1  FOR  calc. loops 
SEQ 

start  clock 

to. handler  !  calcs .per .packet 

— •-  initialize  nodes 

tag  :=  setup 

to. router  I  bundle 

generate  and  send  packets 

tag  :=  data 

setup. array [0 ]  :=  base. calc  TIMES  calcs .per .packet 
SEQ  j  =  0  FOR  total. bundles 
to. router  !  bundle 

wait  till   all   results   have  been  received  and 

graphed 
from. handler  ?  any 

request  report 

tag  :=  report 

to. router  !  bundle 


PROC  results. router (CHAN  OF  ANY   from. router,  trigger, 

results ) 

declarations 

[bundle. size] BYTE  bundle  : 
VAL  packet. done    IS   TRUE  : 

WHILE  TRUE 
SEQ 

results  ?  bundle 
PAR 

trigger  !  packet. done 
from. router  !  bundle 
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PROC  work . router (CHAN  OF  ANY  to. router,  trigger,  requests 

declarations 

[bundle. size] BYTE   bundle: 

INT   tag   RETYPES   [bundle  FROM  0  FOR  4]: 

BOOL   packet. done,  reporting: 

INT    workCOUNT: 

SEQ 

— -  initialization 
workCOUNT  :=  0 
reporting  :=  FALSE 

WHILE  TRUE 
PRI  ALT 

trigger  ?  packet. done 
IF 

NOT  reporting 

workCOUNT  :=  workCOUNT  -  1 
else 
SKIP 

(workCOUNT  <=  workSIZE)  &  to . router  ?  bundle 
IF 

tag  =  data 
SEQ 

requests  !  bundle 
workCOUNT  :=  workCOUNT  +  1 

tag  =  setup 
SEQ 

reporting  :=  FALSE 
requests  !  bundle 

tag  =  report 
SEQ 

reporting  :=  TRUE 
requests  !  bundle 


64 


PROC  handler (CHAN  OF  ANY  from. router ,  to. handler, 
from. handler ,  screen,  keyboard) 

declarations 

[bundle. size] BYTE       bundle: 

[]INT   report. array      RETYPES    [bundle  FROM  0  FOR  8]: 

INT    node. id  IS        report . array [0 ] : 

INT    num. node. bundles  IS        report . array [ 1 ] : 

VAL  go  IS        1: 

TIMER  clock: 

INT  start. time,  stop. time: 

INT  calcs .per .packet : 

SEQ 

WHILE  TRUE 
SEQ 

start  clock  on  controls  command 

to. handler  ?  calcs .per .packet 
clock  ?  starts  time 

receive  data  packets 

SEQ  i  =  0  FOR  total. bundles 
from. router  ?  bundle 

stop  the  timer 

clock  ?  stop. time 

let  controller  know  all  done  graphing 

from. handler  !  go 

make  terminal  report 

write. int( screen, (stop. time-start .time)  TIMES  64,9 
write . int ( screen , ( calcs . per . packet  TIMES 

base.calc) ,  4 
SEQ  i  =  0  FOR  farmSIZE 
SEQ 

from. router  ?  bundle 

write. int (screen,  num. node . bundles ,  4) 

newline ( screen ) 
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request  router 


declarations 

[bundle. size] BYTE  bundle: 

INT  tag  RETYPES    [bundle  FROM  0  FOR  4]: 

BOOL  d .buffer . empty  : 

SEQ 

d. buffer .empty  :=  TRUE 
WHILE  TRUE 
PRI  ALT 

signal  ?  d .buffer .empty 

SKIP 
requests . in  ?  bundle 
IF 

tag  =  data 
IF 

d . buffer . empty 
SEQ 

d. buffer .empty  :=  FALSE 
to. buffer  !  bundle 
else 

requests. out  !  bundle 

tag  =  setup 
IF 

proc.id  <  (MAXnumT8-l) 
PAR 

requests. out     !  bundle 
to. buffer  !  bundle 

else   — ■-  last  node 
to » buffer  !  bundle 

tag  =  report 
IF 

proc.id  <  (MAXnumT8~l) 
PAR 

requests. out     !  bundle 
to. buffer  !  bundle 
else 

to. buffer  !  bundle 
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request  buffer 


declarations 

[bundle. size] BYTE  bundle: 

INT  tag  RETYPES    [bundle  FROM  0  FOR  4] 

VAL  buffer. empty   IS  TRUE  : 

WHILE  TRUE 
SEQ 

to. buffer  ?  bundle 
IF 

tag  =  data 
SEQ 

to. calculation  !  bundle 
signal  !  buffer .empty 

tag  =  setup 

to. calculation  !  bundle 
tag  =  report 

to. calculation  !  bundle 


result  buffer 


[bundle. size] BYTE   bundle: 

WHILE  TRUE 
SEQ 

from. calculation  ?  bundle 
from. buffer  !  bundle 


result  router 
bundle: 


bundle 
!  bundle 
?  bundle 
!  bundle 


[ bundle . size ] BYTE 
WHILE  TRUE 
PRI  ALT 

from. buffer  ? 
results . out 
results . in 
results . out 
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calculation 


declarations 

[ bundle «  size] BYTE 
[]INT  setup. array 
[]INT  report. array 
[packet . size ] BYTE 
INT  tag  RETYPES 
INT  calcs .per .packet 
INT  num. node. bundles 
REALS 2  x: 


bundle. in,  bundle. out: 

RETYPES  [bundle. in  FROM  4  FOR  i 

RETYPES  [bundle. out  FROM  0  FOR 

work . array : 

[bundle. in  FROM  0  FOR  4]: 

IS  setup. array [0 ] : 


SEQ 

WHILE  TRUE 
SEQ 

to . calculation  ?  bundle. in 
IF 

tag  =  data 
SEQ 

SEQ  i  =  1  FOR  packets .per .bundle 
SEQ 

[work. array  FROM  0  FOR  4]  :=  [bundle. in  FROM 

(i  TIMES  4)  FOR  4] 
SEQ  j  =  0  FOR  calcs. per .packet 

X  :=  x*x 
SEQ  j  =  0  FOR  packet. Size 
bundle.out[j ]  :=  2 (BYTE) 

from. calculation  !  bundle. out 

num. node. bundles  :=  num. node. bundles  +  1 

tag  =  setup 
SEQ 

num. node. bundles  :=  0 
x  :=  0.9999(REAL32) 

tag  =  report 
SEQ 

report .array [0 ]  :=  proc.id 

report . array [ 1 ]  :=  num. node . bundles 

from. calculation  !  bundle. out 
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APPENDIX  C 

COORDINATE  TRANSFORMATION  PROBLEM 
SOURCE  CODE 

Only  those   portions  of  code  different  from  that  of  the 
generic  workfarm  are  included  in  this  Appendix. 


— -  global  variable  file 

VAL   total. bundles  IS 

VAL  total. packets  IS 

VAL  packets .per .bundle  IS 

VAL   bundle. size  IS 


128: 

16384: 

total . packets/total . bundles 

385: 


FROG  generator (CHAN  OF  ANY  to. router,  to. handler, 

from. handler ,  from. scanner ) 


— -  declarations 

[bundle. size] BYTE   bundle: 

[]REAL32  setup. array  RETYPES 


BYTE 
REAL 3 2 
REAL 3 2 
REAL 3 2 
REAL 3 2 
REAL 3 2 
REAL 3 2 
INT 


tag  IS  bundle[0] : 
ASV. pitch  IS  setup. array [0 ] : 
ASV.az  IS  setup. array [1 ] : 
ASV. roll  IS  setup.array[2] : 
ASV.x  IS  setup.array[ 3] : 
ASV.y  IS  setup. array [4 ] : 
ASV.z  IS  setup. array [5 ] : 
index ,  any : 


[bundle  FROM  4  FOR  24] 


SEQ 

---  start  clock 
to. handler  !  1 

initialize  nodes 


tag  :=  setup 

ASV. pitch 

ASV.az 

ASV. roll 

ASV.x 

ASV.y 

ASV.z 


0.0(REAL3  2) 
0.0(REAL32) 
0.0(REAL3  2) 
0.0(REAL3  2) 
64.0(REAL32) 
-8.0(REAL32) 


■-asv .pitch 
-asv . az 
•-asv . roll 
•-asv .  X 
•--asv .y 
— asv . z 


to. router  !  bundle 
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generate  and  send  packets 

tag  :=  data 
SEQ  i  =  0  FOR  128 
SEQ 

SEQ  j  =  0  FOR  128 
SEQ 

index  :=  j  TIMES  3 
bundle [ index+1]  :=  BYTE  i 
bundle [index+2]  :=  BYTE  j 
from. scanner  ?  bundle [ index+ 3 ] 
to. router  !  bundle 

request  report 

from. handler  ?  any 

tag  :=  report 

to. router  !  bundle 


PROC  handler (CHAN  OF  ANY  from. router,  to. handler, 
from. handler ,  to. graph,  from. graph) 

declarations 

[128] [128]INT   terrain. map: 
[bundle. size] BYTE   bundle: 


[  ]INT 

report. array   RETYPES 

[bundle  FROM  0  FOR 

INT 

node. id        IS 

report .array [0 ] : 

INT 

node. bundles    IS 

report. array[l] : 

VAL 

ready          IS 

1: 

INT 

start. time,  stop. time  : 

INT 

total. bundles: 

TIMER 

cloclc: 

INT 

x.int,  y.int,  z.int: 

INT 

any,  index: 

SEQ 

init 

SEQ  i  =  0  FOR  128 
SEQ  j  =  0  FOR  128 

terrain. map[ i] [j ]  :=  0 

WHILE  TRUE 
SEQ 

start  clock  on  controls  command 

to. handler  ?  any 
clock  ?  start. time 
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receive  data  packets 

SEQ  i  =  0  FOR  128 
SEQ 

from. router  ?  bundle 
SEQ  j  =  0  FOR  128 
SEQ 


index 
X.  int 
y  .int 
z .  int 


=  j  TIMES  3 

=  INT  bundle [index] 

=  INT  bundle [ index+1 ] 

=  (INT  bundle [ index+2 ] )  -  128 


terrain.map[y . int] [X. int ]  :=  z . int 

stop  tlie  timer 

cloclc  ?  stop. time 

---  let  controller  Icnow  all  done  graptiing 
from. handler  I  ready 

■  make  terminal  report 

newline ( to . graph ) 

newline ( to . graph ) 

write. int (to. graph, ( stop. time- start .time) *6  4 , 10 ) 

newline ( to . graph ) 

total. bundles  :=  0 

SEQ  i  =  0  FOR  farmSIZE 
SEQ 

from. router  ?  bundle 

write. int (to. graph,  node. id,  3) 

write. int (to. graph,  node. bundles ,  10) 

total .bundles  :=  total .bundles  +  node. bundles 

newline ( to . graph) 

newline ( to . graph ) 

write. int (to. graph,  total .bundles ,  13) 

■  display  wire  terrain  graph  on  SONY 

[128] INT  altitude. array: 

VAL   XMID  IS  256: 

VAL   YBASE  IS  450: 

VAL   scalefactor       IS  200000/256: 

INT   reply,  horiz,  vert,  x.old,  y.old,  x.new,  y.new 

INT   horizl,  vertl : 
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SEQ 

initializ 

SEQ  i  =  0  FOR 
altitude . ar 
vert  :=  0 
to. graph  ! 
from. graph 
to. graph  I 
from. graph 
to. graph  ! 
from. graph 
to. graph  ! 
from. graph 
to. graph  ! 
from. graph 
to. graph  I 
from. graph 
to. graph  ! 
from. graph 


c. 

c. 

c . 
7 

c. 
7 

c. 
7 

c. 
7 

c . 

-? 


ation 

128 
ray[i]  :=  512 

select . bg . colour ; 24 

reply 

select . f g . colour ; 2 

reply 

init .crt 

reply 

select . screen ; 0 

reply 

clear .screen ;0 

reply 

display . screen; 0 

reply 

move; 256; 450 

reply 


SEQ  i  =  0  FOR  128 


SEQ 
horiz 
horizl 
vertl 
x.old 
y  .old 


=  2 

:=  (horiz  *  scalef actor ) /lOOO 

=  (vert  *  scalefactor ) /lOOO 

=  XMID  -  vert 

=  YBASE  -  (vertl  +  terrain. map[ i ][ 0 ] 


process  row 


SEQ  j 
SEQ 

X 

y 


=  1  FOR  127 

new  :=  (XMID  +  horiz)  -  vert 

new  :=  YBASE  -  (horizl  +  (vertl  + 

t er rain. map [ i] [ j ] ) ) 
—  drawline 


IF 


y.new  <  altitude . array [j ] 
SEQ 

to. graph  !   c. draw. line;  x.old; 

y.old;  x.new;  y.new 
from. graph  ?  reply 
altitude. array [j ]  :=  y.new 
else 


vert 


SKIP 

x.old  := 

X  .new 

y.old  := 

y  .new 

horiz  := 

horiz  +  2 

horizl  := 

=  (horiz  * 

.  :=  vert 

+  2 

scalefactor) /lOOO 
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Calculation 


bundle  declarations 


[ bund 1 e . s  i  z  e ] BYTE 
[bundle. size] BYTE 
[ JREAL3  2  setup. array 
[ ] INT    report . array 
BYTE     tag 


INT 


bundle. in: 

bundle . out : 

RETYPES   [bundle. in  FROM  4  FOR  24] 

RETYPES   [bundle. out  FROM  0  FOR  8] 

IS       bundle. in[0 ] : 


node. bundles : 


computation  variables 

BYTE   x.byte,  y.byte,  z^byte: 

INT    X . int ,  y . int ,  z . int : 

REAL32  x.real,  y.real,  z « real : 

REAL 32  a,b,c,e,f,g,i,j,]<:: 

REAL32  c4c5,  s4c5,  d9s8,  four,  eight,  twelve: 

REAL 3 2  C4,c5,c6,c7,c8,s4,s5,s6,s7,s8,a7,d9: 

REAL32  scanner. az,  scanner .pitch,  target . range: 

REAL32  ASV.x,  ASV . y ,  ASV . z ,  ASV.az,  ASV. pitch,  ASV.roll: 

REAL32  tempi,  temp2 ,  temp3,  temp4 : 

BYTE   raw. scanner .pitch,  raw. scanner .az ,  raw. target . range: 

---  constants 

VAL  Pi  IS  3.1416(REAL32) : 
VAL  PiBy2  IS  Pi/2 . 0 (REAL32 ) : 
VAL  factor  IS  Pi/180 . 0 (REAL32 ) : 

INT   index: 
SEQ 

WHILE  TRUE 
SEQ 

to. calculation  ?  bundle. in 
IF 

tag  =  data 
SEQ 

SEQ  z  =  0  FOR  128 
SEQ 

index  :=  z  TIMES  3 

process  raw  data  paclcet : 

pitch  into  degrees  from  -15  to  -75 

convert  az  into  degrees  from  -40  to  +40 

convert  range  into  feet  from  0  to  32 

tempi  :=  REAL32  ROUND 

(INT  bundle. in [ index+1 ] ) 
temp2  :=  15.0(REAL32) 
temp3  :=  1 . 47244 (REAL32 )  *  tempi 
scanner .pitch  :=  tempi  -  (temp2  +  temp3) 
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temp4  :=  REAL 3 2  ROUND 

(INT  bundle. in [ index+2] ) 
scanner. az  :=  (temp4  *  0 . 6299 (REAL32 ) )  - 

40 .0 (REAL32) 

target. range  :=  (REAL32  ROUND 

(INT  bundle. in [index+3] ) ) /8 .0 (REAL32) 

■  do  sines  and  cosines 

scanner .pitch  :=   (factor  *  scanner . pitch)  ■ 

PiBy2 
scanner. az  :=  (factor  *  scanner. az)  -  PiBy2 
C0SP(c7,  scanner .pitch) 
C0SP(c8,  scanner. az) 
SINP(s7,  scanner .pitch) 
SINP(s8,  scanner. az) 


---  assign  variables 
d9s8     :=    s8*target. range 
four     :=     (d9s8  *  c7 )  +  (a7 
eight    :=     (d9s8  *  s7)  +  (a7 
twelve   :=    c8*target . range 


c7 
s7 


---  calculate  3  points  of  the  4x4  matrix 
x.real  :=  ASV.x  +  ((a  *  four)  +  ((b  *  eight) 

+  (c  *  twelve) ) ) 
y.real  :=  ASV.y  +  ((e  *  four)  +  ((f  *  eight) 

+  (g  *  twelve) ) ) 
z.real  :=  ASV.z  +  ((i  *  four)  +  ( ( j  *  eight) 

+  (k  *  twelve) ) ) 

— ■-  convert  results  into  bytes 

bundle. out [index]  :=  BYTE  (INT  ROUND  x.real) 

bundle. out [index+1]  :=  BYTE  (INT  ROUND 

y . real ) 
bundle. out [index+2]  :=  BYTE  ((INT  ROUND 

z.real)  +  128) 
from. calculation  !  bundle. out 
node. bundles  :=  node. bundles  +  1 

tag  =  setup 
SEQ 

node. bundles  :=  0 

ASV. pitch  :=  setup. array [ 0 ] 

ASV.az  :=  setup. array [ 1 ] 

ASV. roll  :=  setup . array [ 2 ] 

ASV.x  :=  setup.array[ 3 ] 

ASV.y  :=  setup. array [ 4 ] 

ASV.z  :=  setup. array [ 5 ] 
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convert  degrees  into  radians 


ASV. pitch 
ASV.az 
ASV. roll 


=  factor  *  ASV. pitch 
=  factor  *  ASV.az 
=  factor  *  ASV. roll 


do  sines  and  cosines 

SINP(s4,  (ASV.az  +  Pi) ) 

SINP(s5,  (ASV. pitch  -  PiBy2)) 

SINP(s6,  (ASV. roll  +  Pi)) 

C0SP(c4,  (ASV.az  +  Pi)) 

C0SP(c5,  (ASV. pitch  -  PiBy2)) 

C0SP(c6,  (ASV. roll  +  Pi)) 

---  assign  variables 
c4c5  :=  c4*c5 
S4c5  :=  s4*c5 

a  :=  (c4c5*c6 )  +  (s4*s6  ) 

b  :=  C4*s5 

c  :=  (C4c5*s6)-(s4*c6) 

e  :=  (S4c5*c6)-(c4*s6) 

f  :=  s4^s5 

g  :=  (s4c5*s6 )+(c4*c6 ) 

i  :=  s5*c6 
j  :=  -c5 
k  :=  s5*s6 

a7  :=  -0.5(REAL32) 

tag  =  report 
SEQ 

report . array [0 ]   :=  proc.id 
report . array [1 ]   :=  node. bundles 
from. calculation  I  bundle. out 
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PROC  scanner  (CHAN  OF  ANY  from. scanner 


declarations 

[128] [128JBYTE  range: 

VAL  Pi  IS  3.1416(REAL32) : 

VAL  factor  IS  Pi/180. 0 (REAL32 ) : 

REAL3  2  angle. deg,  angle. rad,  cosangle,  deg.inc 

BYTE  range. byte: 

SEQ 

---  initialize  array  of  range  values 
angle. deg  :=  75.0(REAL32) 
angle. rad  :=  factor  *  angle. deg 
COSP (cosangle,  angle. rad) 

range. byte  :=  BYTE  (INT  ROUND  ( 64 . 0 (REAL3 2 ) /cosangle) ) 
SEQ  i  =  0  FOR  128 
SEQ 

SEQ  j  =  0  FOR  128 

range[i][j]  :=  range. byte 
angle. deg  :=  angle. deg  -  0 . 46875 (REAL32 ) 
angle. rad  :=  factor  *  angle. deg 
COSP (cosangle,  angle. rad) 
range. byte  :=   BYTE  (INT  ROUND 

( 64. 0(REAL32) /cosangle) ) 

---  pump  out  range  BYTEs 
SEQ  i  =  0  FOR  128 
SEQ  j  =  0  FOR  128 

from. scanner  !  range[i][j] 
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APPENDIX  D 


MANDELBROT  SET  PROBLEM  SOURCE  CODE 


Mandelbrot  global  constants 


VAL  MAXnumTS 

VAL  packetSIZE 

VAL  else 

VAL  rSIZE 

VAL  iSIZE 

VAL  rSTEPS 

VAL  packetCOUNT 

VAL  countLIMIT 


IS  8: 

IS  16: 

IS  TRUE; 

IS  512: 

IS  512: 

IS  rSIZE/packetSIZE 

IS  rSTEPS  *  iSIZE  : 

IS  255: 


VAL   farms I ZE 
VAL   workSIZE 


IS  MAXnumTS: 

IS  (farmSIZE  *  2) 


-  1 


VAL 

data 

IS  1: 

VAL 

setup 

IS  2: 

VAL 

report 

IS  3: 

PROC  root (CHAN  OF  ANY  to. graph,  from. graph, 

requests ,  results ) 


internal  channels 


CHAN  OF  ANY 
CHAN  OF  ANY 
CHAN  OF  ANY 


to. router,  from. router: 
to. handler,  from. handler 
trigger: 


VAL  zoom. in    IS  0: 

VAL  zoom. out   IS  1: 

VAL  rSIZE.real  IS  (REAL64  ROUND  rSIZE) : 

VAL  iSIZE.real  IS  (REAL64  ROUND  iSIZE): 


PAR 


generator (to. router ,  to. handler,  from. handler ) 
work . router ( to . router ,  trigger,  requests) 
results . router ( from. router ,  trigger,  results) 
handler ( from. router ,  to. handler,   from. handler ,  to. graph, 
from. graph) 
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PROC  generator (CHAN  OF  ANY  to. router,  to. handler, 

from. handler ) 

data  variables 
[12]BYTE  data. array: 

INT  tag  RETYPES  [data. array  FROM  0  FOR  4]: 
[]INT  START  RETYPES   [data. array  FROM  4  FOR  8]: 
INT  rSTART  IS  START[0]: 
INT  iSTART  IS  START[1]: 

REAL64  setup. value  RETYPES  [data. array  FROM  4  FOR  8]: 
■  REAL 6 4     rMIN,  rMAX,  IMIN,  IMAX  : 

REAL64     rMIN. temp,  rMAX. temp,  iMIN.temp,  iMAX.temp 

REAL64    ul.x . real,ul .y . real,lr .x. real,lr .y . real : 

REAL64     rMID,  IMID: 

INT       mode  : 

INT       any,  ul.x,  ul.y,  Ir.x,  Ir.y  : 


SEQ 
rMIN 
rMAX 
IMIN 
IMAX 


-2.0(REAL64) 
0.5(REAL64) 
1.25(REAL64) 
-lo25(REAL64) 
WHILE  TRUE 
SEQ 

- — ■  initialize  nodes 

tag  I-   setup 

setup. value 

to. router 

setup. value 

to . router 

setup. value 

to. router 

setup. value 

to  c  router 


rMIN 

data. array 

rMAX 

data  o  array 

iMIN 

data . array 

iMAX 

data . array 


to. handler  !  1 

---  send  packets 
tag  :=  data 
SEQ  i  =  0  FOR  iSIZE 
SEQ 

iSTART  : =  i 
SEQ  j  =  0  FOR  rSTEPS 
SEQ 

rSTART  :=  j  *  packetSIZE 
to. router  !  data. array 


report 

from. handler  ?  any 

tag  :=  report 

to. router  !  data. array 


get  new  plot  coordinates 

from. handler  ?  mode;  ul.x;  ul 
INT3  2TOREAL6  4 (ul . x . real ,ul . x ) 
INT  3  2TOREAL6  4 ( ul . y . real , ul , y ) 
INT32TOREAL64 ( Ir . x . real , Ir . x ) 
INT32TOREAL64 ( Ir . y . real , Ir . y ) 


y;  Ir.x;  Ir.y 


ul . X . real  : =  REAL6 4 
ul.y.real  :=  REAL64 
Ir.x. real  :=  REAL64 
Ir.y. real  :=  REAL64 
IF 

mode  =  zoom. in 
SEQ 

rMIN.temp  := 


ROUND 
ROUND 
ROUND 
ROUND 


ul 
ul 
Ir 


x 

y 

X 


Ir.y 


rMAX . temp  : = 
iMIN.temp  := 
iMAX.temp  := 


rMIN 
rMAX 
iMIN 
iMAX 
mode  =  zoom, 


( ( (rMAX-rMIN)*ul.x.real 
/rSIZE.real)+rMIN 
( ( (rMAX-rMIN)*lr.x.real) 
/rSIZE.real)+rMIN 
( ( (iMIN-iMAX)*lr.y.real 
/iSIZE.real)+iMAX 
( ( ( iMIN- iMAX ) *ul . y . real ) 
/iSIZE.real)+iMAX 
rMIN.temp 
rMAX . temp 
iMIN.temp 
iMAX . temp 
out 


REAL64  scale. factor 
SEQ 

scale. factor  := 


rMID 
iMID 
rMIN 
rMAX 
iMIN 
iMAX 


rSIZE.real/ 
(Ir.x. real-ul . x . real ) 
(rMAX  +  rMIN)/(2.0(REAL64) ) 
(iMAX  +  iMIN)/(2.0(REAL64) ) 
rMID  -  ( scale. factor* ( rMID-rMIN) ) 
rMID  +  ( scale. f actor* ( rMAX-rMID ) ) 
iMID  -  (scale. factor* ( iMID-iMIN) ) 
iMID  +  ( scale. factor* ( iMAX-iMID ) ) 
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PROC  handler (CHAN  OF  ANY  from. router,  to. handler, 

f rom. handler ,  to. graph,  from. graph) 

declarations 

[16  +  packetSIZE]BYTE  graph. array  : 
INT  v.c.man  RETYPES  [graph. array  FROM  0  FOR  4]: 
INT  v.pSIZE  RETYPES  [graph. array  FROM  4  FOR  4]: 
[]BYTE  result. array   IS  [graph. array  FROM  8  FOR 

(8+packetSIZE) ] : 
INT  node. packets  RETYPES  [ result . array  FROM  0  FOR  4] 
INT  node. loops   RETYPES  [ result . array  FROM  4  FOR  4] 
BYTE  node. id  IS  result . array [ 8 ] : 
INT   range,  reply: 

INT  n.x,  n.y,  m.x,  m.y,  1.x, l.y,  buttons: 
INT   delta. X,  delta. y: 

BOOL  m.l,  m.m,  m.r,  select. ok,  done. select: 
INT  start. time,  stop. time,  recirc: 
INT   total. loops,  total .packets : 
TIMER  clock: 
INT  any: 

SEQ 

---  initialization 
v.c.man  :=  c.mandelbrot 
V.pSIZE  :=  packetSIZE 


WHILE  TRUE 

SEQ 

---  init  graphics  display 

to. graph 

c  chide. cursor 

from. graph 

7 

reply 

to. graph 

c . init .crt 

from. graph 

7 

reply 

to. graph 

c. select. screen  ;  0 

from .graph 

7 

reply 

to. graph 

c .clear . screen   ;  0 

from. graph 

7 

reply 

to. graph 

c .display . screen;  0 

from. graph 

7 

reply 

to. graph 

c . select . colour . table;  1 

from. graph 

7 

reply 

to . graph 

c . set . colour ;  countLIMIT; 

from. graph 

7 

reply 

0;  0;  0 


start  clock 

to. handler  ?  any 
clock  ?  start. time 
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receive  packets 

SEQ  i  =  0  FOR  packetCOUNT 
SEQ 

from. router  ?  result. array 

to. graph  !  graph. array 

stop  clock 

clock  ?  stop. time 

let  controller  know  all  done 

from. handler  !  1 

- —  make  terminal  report 

newline ( to . graph ) 

newline ( to . graph ) 

write. int( to. graph, (stop.time-start . time) *64 , 10 ) 

newline ( to . graph ) 

total. loops  :=  0 

total. packets  :=  0 

SEQ  i  =  0  FOR  farmSIZE 
BYTE  char: 
SEQ 

from. router  ?  result. array 

write. int( to. graph, (INT  node. id ) , 3 ) 

write. int( to. graph, node. packets, 10 ) 

write. int( to. graph, node. loops , 10 ) 

total. loops  :=  total. loops  +  node. loops 

total .packets  :=  total. packets  +  node. packets 

newline ( to . graph ) 

newline ( to . graph ) 

write. int( to. graph,  total. packets ,  13) 

write. int( to. graph,  total. loops,  10) 

newline ( to . graph ) 

write. int( to. graph, 

(512*(512/packetSIZE) ) -total .packets , 13  ) 

write. int( to. graph, total. loops /total. packets, 10 ) 

newline ( to . graph ) 

newline ( to . graph ) 

get  the  new  coordinates  for  calculation 

---  set-up  for  rectangle 

to. graph  !  c.copy. screen;  0 

from. graph  ?  reply 

to. graph  !  c . select . fg . colour ;  15 

from. graph  ?  reply 

get  the  current  mouse  stats 

to. graph  !  c. show. cursor 
from. graph  ?  reply 
done. select  :=  FALSE 
select. ok  :=  FALSE 


WHILE  NOT  done. select 
SEQ 

wait  for  any  mouse  button  to  be  pressed 

to. graph  !  c. get. mouse 
from. graph  ?  n. x;n.y ;m. l;m.m;m. r 
WHILE  (NOT  m.m)  AND  ((NOT  m.l)  AND  (NOT  m.r)) 
SEQ 

to. graph  !  c. get. mouse 

from. graph  ?  n.x;n.y;m.l;m.m;m. r 

IF 
m.m 

BOOL  new. select: 
SEQ 

m.x  : =  n. X 
m.y  :=  n.y 
1.x  : =  m. X 
l.y  :=  m.y 
new. select  :=  TRUE 

process  mouse  input  until  middle  mouse 

is  released 

WHILE  m.m 
SEQ 

to. graph  !  c. get. mouse 

from. graph  ?  n.x;n.y ;m.l;m.m;m. r 

IF 

((n.x  <>   1.x)  OR  (n.y  <>  l.y))  OR 
new. select 
SEQ 

new. select  :=  FALSE 

to. graph  !  chide. cursor 

from. graph  ?  reply 

to. graph  !  c .copy . screen;  1 

from. graph  ?  reply 

set  new  corner  coordinates 

delta. X  :=  n.x  -  m.x 
delta. y  :=  n.y  -  m.y 
IF 

delta. X  >  0 
IF 

delta. y  >  0 
IF 

delta. X  >  delta. y 

delta. X  :=  delta. y 
TRUE 

delta. y  :=  delta. x 
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TRUE 
IF 


delta. X  >  (-delta. y) 
delta. X  :=  -delta. y 

TRUE 

delta. y  :=  -delta. x 


TRUE 
IF 


delta. y  >  0 
IF 

( -delta. X)  >  delta. y 

delta. X  :=  -delta. y 
TRUE 

delta. y  :=  -delta. x 
TRUE 
IF 

( -delta . X ) > ( -delta . y ) 
delta. X  :=  delta. y 
TRUE 

delta. y  :=  delta. x 
1 .X  : =  n.x 
l.y  :=  n.y 
to. graph  !  c. draw. rectangle; 

m.x;  m.y;  delta. x;  delta. y 
from. graph  ?  reply 
to. graph  !  c . show. cursor 
from. graph  ?  reply 
TRUE 
SKIP 


---  order  the  screen  coordinates  for 
proper  range 


1.x  :=  m.x  + 

delta. X 

IF 

m.x  >  1.x 

SEQ 

n.x  :  = 

m.x 

m.x  :  = 

1.x 

1.x  :  = 

n.x 

TRUE 

SKIP 

l.y  : =  m.y  + 

delta .y 

IF 

m.y  >  l.y 

SEQ 

n.y  :  = 

m.y 

m.y  :  = 

l.y 

l.y  :  = 

n.y 

TRUE 

SKIP 
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select. ok  :=  (delta. x  <>  0)  AND 
(delta. y  <>  0) 

right  mouse  button  hit,  do  zoom  in 

m.r  AND  select. ok 
SEQ 

done. select  :=  TRUE 
graph. results  !  zoom. in;  m.x;  m.y; 

1.x;  l.y 

---  left  mouse  button  hit,  do  zoom  out 
m.l  AND  select. ok 
SEQ 

done. select  :=  TRUE 
graph. results  !  zoom. out;  m.x;  m.y; 

1.x;  l.y 

TRUE 
SKIP 
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